-- Logs begin at Tue 2022-09-13 00:39:22 UTC, end at Tue 2022-09-13 01:35:15 UTC. -- Sep 13 01:10:05.610371 dv-cinder-856941-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 01:10:05.617634 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 01:10:05 2022] *** Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: nodename: dv-cinder-856941-3-iscsi Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: machine: x86_64 Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: clock source: unix Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: pcre jit disabled Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: detected number of CPU cores: 4 Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: current working directory: / Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: detected binary path: /usr/bin/uwsgi-core Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: your processes number limit is 47680 Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: your memory page size is 4096 bytes Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: detected max file descriptor number: 2048 Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: lock engine: pthread robust mutexes Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: thunder lock: enabled Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 01:10:05.621784 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 01:10:05.660132 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: Python main interpreter initialized at 0x55cca731f9c0 Sep 13 01:10:05.660132 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: python threads support enabled Sep 13 01:10:05.660132 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: your server socket listen backlog is limited to 100 connections Sep 13 01:10:05.660132 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: your mercy for graceful operations on workers is 90 seconds Sep 13 01:10:05.660445 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 01:10:05.660521 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: *** Operational MODE: preforking *** Sep 13 01:10:05.660745 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: *** uWSGI is running in multiple interpreter mode *** Sep 13 01:10:05.660745 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: spawned uWSGI master process (pid: 105425) Sep 13 01:10:05.660927 dv-cinder-856941-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 01:10:05.661580 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: spawned uWSGI worker 1 (pid: 105426, cores: 1) Sep 13 01:10:05.661804 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: spawned uWSGI worker 2 (pid: 105427, cores: 1) Sep 13 01:10:05.661961 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 01:10:06.311666 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 01:10:06.312281 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 01:10:07.386082 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 01:10:07.386082 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: from cryptography.utils import int_from_bytes Sep 13 01:10:07.386714 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 01:10:07.386714 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: from cryptography.utils import int_from_bytes Sep 13 01:10:07.387204 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 01:10:07.387204 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: from cryptography.utils import int_from_bytes Sep 13 01:10:07.387318 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 01:10:07.387318 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: from cryptography.utils import int_from_bytes Sep 13 01:10:09.832596 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 01:10:09.833273 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 01:10:09.833635 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 01:10:09.833724 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 01:10:09.833813 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 01:10:09.833900 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 01:10:09.833992 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 01:10:09.834079 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 01:10:09.834164 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 01:10:09.834248 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 01:10:09.834332 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.834422 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.834614 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.834711 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.834965 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.835069 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.835284 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.835387 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.835606 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.835700 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.835906 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.835998 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.836727 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.836901 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.837042 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.837140 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.837362 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.837469 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.837616 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.837718 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.837923 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.838009 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.838235 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856941-3-iscsi {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.838333 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856941-3-iscsi {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.838590 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.838724 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.838836 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.838963 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.839146 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.839246 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.839455 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.839548 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.839749 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.839844 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.840061 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.840159 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.840357 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.840449 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.840850 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.840952 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.842009 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.842151 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.842264 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.842356 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.842440 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.842532 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.842617 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.842696 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.842767 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.842872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.842969 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.843062 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.843202 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.843292 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.843377 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.843454 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.843675 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.843779 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.843975 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.844129 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.844366 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856941-3-iscsi {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.844509 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856941-3-iscsi {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.844674 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.844771 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.845030 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.845137 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.845277 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.845412 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.845679 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.845798 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.845986 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.846078 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.846288 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.846385 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.846599 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.846691 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.846938 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.847029 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.847239 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.847336 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.847555 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.847653 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.847864 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.847958 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.848176 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.848262 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.848485 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.848587 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.848777 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.848869 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.849076 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.849181 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.849378 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.849471 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.849685 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.849771 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.849980 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.850074 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.850277 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.850384 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.850520 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.850612 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.850818 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.850949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.851156 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.851252 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.851470 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.851566 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.851782 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.852448 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.852571 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.852667 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.852817 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.852910 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.853129 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.853224 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.853440 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.853536 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.853741 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.853839 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.854040 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.854132 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.854340 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.854433 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.854640 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.854735 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.854961 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.855079 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.855263 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.855350 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.855561 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.855664 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.855860 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.855956 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.856169 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.856254 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.856475 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.856568 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.856789 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.856876 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.857088 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.857189 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.857400 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.857493 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.857786 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.857880 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.858033 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.858120 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.858332 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.858426 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.858661 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.858746 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.858993 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.859083 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.859298 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.859398 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.859608 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.859693 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.859921 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.860025 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.860222 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.860313 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.860521 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.860622 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.860819 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.860913 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.861128 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.861212 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.861453 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.861584 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.861748 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.861851 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.861991 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.862076 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.862282 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.862375 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.862577 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.862674 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.862903 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.862994 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.863206 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.863293 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.863505 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.863599 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.863801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.863893 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.864092 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.864222 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.864392 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.864486 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.864689 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.864781 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.864986 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.865077 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.865283 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.865374 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.865579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.865663 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.865875 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.865958 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.866168 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.866254 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.866464 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.866548 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.866758 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.866843 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.867076 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.867173 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.867386 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.867471 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.867723 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.867817 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.868022 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.868114 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.868319 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.868418 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.868616 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.868701 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.868913 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.869008 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.869224 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.869309 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.869521 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.869606 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.869816 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.869908 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.870127 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.870212 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.870423 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.870516 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.870720 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.870805 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.871051 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.871146 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.871349 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.871447 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.871647 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.871750 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.871951 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.872045 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.872241 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.872340 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.872538 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.872622 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.872844 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.872929 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.873140 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.873240 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.873436 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.873522 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.873729 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.873834 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.874021 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.874115 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.874315 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.874408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.874611 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.874696 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.874928 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.875032 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.875225 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.875310 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.875517 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.875605 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.875826 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.875912 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.876136 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.876228 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.876435 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.876520 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.876732 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.876819 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.877027 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.877111 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.877335 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.877421 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:10:09.877661 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.877758 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.877984 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.878070 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.878319 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.878411 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.878624 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.878717 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.878974 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.879074 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.879301 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.879400 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.879609 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.879694 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.879912 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.879998 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.880218 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.880312 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.880536 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.880622 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.880839 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.880925 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.881144 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.881242 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.881445 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.881542 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.881755 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.881937 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.882063 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.882158 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.882383 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.882475 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.882693 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.882778 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.883025 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.883132 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.883363 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.883448 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.883665 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.883750 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.883976 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.884063 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.884296 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.884421 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.884608 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.884692 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.884910 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.885003 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.885241 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.885334 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.885576 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.885661 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.885880 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.885973 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.886195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.886289 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.886506 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.886597 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.886809 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.886928 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.887138 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.887225 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.887440 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.887534 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.887772 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.887866 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.888077 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.888169 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.888380 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.888473 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.888688 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.888773 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.888993 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.889078 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.889307 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.889406 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.889611 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.889704 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.889912 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.890000 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.890215 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.890311 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.890516 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.890609 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.890816 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.890973 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.891163 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.891251 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.891468 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.891560 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.891780 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.891921 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.892085 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.892183 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.892388 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.892481 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.892694 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.892778 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.892995 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.893081 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.893297 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.893388 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.893597 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.893681 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.893892 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.893991 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.894185 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.894270 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.894481 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.894582 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.894781 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.894894 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.895102 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.895187 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.895413 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.895510 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.895730 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.895817 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.896027 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.896111 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.896349 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.896446 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.896645 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.896731 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.896945 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.897037 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.897245 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.897339 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.897544 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.897629 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.897838 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.897930 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.898143 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.898246 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.898443 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.898529 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.899281 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.899377 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.899598 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.899685 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.899901 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.899994 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.900198 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.900283 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.900511 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.900597 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.900806 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.900905 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.901103 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.901196 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.901407 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.901493 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.901710 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.901849 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.902020 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.902153 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.902319 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.902413 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.902621 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.902717 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.902955 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.903063 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.903263 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.903358 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.903565 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.903651 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.903892 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.904007 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.904212 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.904300 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.904506 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.904607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.904823 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.904928 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.905136 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.905223 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.905441 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.905526 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.905738 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.905845 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.906036 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.906123 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.906329 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.906426 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.906624 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.906719 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.906942 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.907045 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.907249 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.907337 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.907542 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.907629 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.907836 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.907923 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.908132 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.908226 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.908428 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.908523 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.908724 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.908809 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.909036 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.909121 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.909335 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.909419 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.909627 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.909722 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.909918 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.910021 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.910212 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.910298 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.910544 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.910632 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.910840 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.910973 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.911194 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.911281 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.911516 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.911650 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.911830 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.911996 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.912139 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.912221 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.912431 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.912527 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.912737 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.912837 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.913037 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.913122 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.913340 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.913425 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.913640 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.913726 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.913940 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.914033 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.914248 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.914362 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.915139 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.915239 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.915454 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.915556 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.915757 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.915883 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.916070 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.916159 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.916372 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.916469 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.916681 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.916766 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.916975 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.917061 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.917281 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.917366 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.917609 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.917704 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.917930 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.918015 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.918238 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.918323 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.918550 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.918644 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.918897 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.918988 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.919178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.919264 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.919481 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.919606 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.919784 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.919883 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.920083 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.920186 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.920383 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.920492 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.920689 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.920784 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.920989 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.921084 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.921296 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.921400 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.921593 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.921696 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.921904 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.922013 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.922202 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.922300 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.922510 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.922594 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.922803 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.922923 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.923133 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.923230 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.923451 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.923544 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.923773 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.923866 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.924074 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.924161 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.924374 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.924467 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.924684 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.924769 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.924983 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.925069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.925285 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.925377 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.925585 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.925679 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.925880 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.926012 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.926173 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.926266 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.926470 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.926569 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.926773 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.926885 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.927099 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.927185 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.927399 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.927497 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.927695 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.927782 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.928002 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.928105 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.928299 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.928394 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.928598 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.928726 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.928892 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.928977 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.929193 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.929279 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.929504 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.929602 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.929808 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.929904 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.930141 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.930242 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.930456 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.930542 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.930753 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.930871 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.931074 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.931164 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.931387 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.931480 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.931687 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.931780 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.931983 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.932077 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.932278 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.932364 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.932571 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.932655 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.933161 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.933254 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.933465 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.933551 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.933759 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.933853 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.934068 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.934154 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.934381 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.934476 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.934680 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.934776 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.935006 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.935110 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.935311 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.935407 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.935612 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.935706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.935920 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.936013 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.936224 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.936318 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.936524 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.936619 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.936826 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.936911 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.937129 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.937222 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.937432 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.937528 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.937734 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.937821 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.938046 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.938138 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.938349 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.938435 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.938655 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.938740 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.938978 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.939069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.939279 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.939367 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.939581 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.939668 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.939893 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.939989 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.940443 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.940530 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.940768 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.940854 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.941076 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.941174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.941383 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.941468 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.941719 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.941815 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.942029 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.942125 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.942349 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.942484 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.942666 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.942754 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.942996 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.943085 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.943297 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.943394 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.943597 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.943695 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.943894 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.943989 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.944188 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.944288 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.944489 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.944581 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.944785 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.944872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.945079 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.945174 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.945376 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.945462 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.945702 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.945789 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.946001 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.946096 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.946299 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.946402 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.946591 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.946676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.946908 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.947010 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.947219 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.947314 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.947516 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.947601 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.947819 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.947906 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.948114 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.948199 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.948430 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.948524 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.948732 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.948819 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.949027 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.949120 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.949323 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.949410 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.949619 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.949706 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.949956 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.950074 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.950251 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.950351 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.950580 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.950677 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.950918 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.951015 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.951253 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.951359 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.951550 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.951647 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.951843 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.951938 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.952155 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.952266 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.952452 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.952586 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.952745 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.952832 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.953038 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.953134 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.953338 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.953434 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.953637 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.953722 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.953928 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.954028 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.954229 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.954315 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.954529 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.954616 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.954828 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.954983 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.955152 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.955252 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.955445 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.955539 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.955742 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.955829 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.956035 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.956121 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.956340 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.956427 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.956639 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.956725 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.956931 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.957024 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.957225 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.957320 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.957525 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.957611 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.957824 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.957919 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.958116 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.958211 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.958417 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.958511 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.958709 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.958794 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.959040 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.959149 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.959337 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.959423 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.959630 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.959716 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.959922 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.960032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.960226 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.960323 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.960523 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.960610 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.960815 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.960904 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.961126 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.961732 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.961951 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.962046 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.962246 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.962341 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.962541 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.962676 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.962842 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.962979 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.963160 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.963249 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.963453 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.963538 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.963751 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.963838 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.964062 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.964149 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.964367 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.964468 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.964663 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.964772 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.964961 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.965048 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.965254 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.965340 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.965548 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.965652 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.965844 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.965930 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.966142 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.966227 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.966435 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.966529 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.966729 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.966814 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.967047 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.967135 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.967343 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.967441 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.967635 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.967721 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.967948 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.968035 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.968247 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.968341 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.968540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.968626 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.968834 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.968921 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.969129 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.969216 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.969457 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.969542 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.969750 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.969836 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.970096 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.970184 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.970394 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.970491 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.970694 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.970779 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.971031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.971120 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.971337 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.971422 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.971639 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.971724 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.971942 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.972029 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.972236 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.972321 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.972541 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.972635 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.972843 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.972931 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.973145 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.973230 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.973438 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.973537 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.973734 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.973819 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.974045 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.974131 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.974348 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.974442 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.974649 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.974734 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.974982 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.975084 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.975297 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.975392 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.975611 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.975704 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.975905 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.975990 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.976205 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.976293 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.976505 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.976591 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.976821 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.976909 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.977658 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.977746 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.977963 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.978049 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.978268 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.978362 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.978575 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.978671 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.978900 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.979002 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.979213 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.979299 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.979516 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.979610 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.979814 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.979900 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.980118 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.980212 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.980423 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.980539 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.980719 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.980821 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.981036 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.981144 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.981335 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.981430 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.981631 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.981731 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.981931 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.982036 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.982226 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.982322 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.982527 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.982625 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.982825 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.982996 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.983258 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.983346 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.983560 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.983646 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.983860 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.983947 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.984155 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.984240 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.984455 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.984539 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.984754 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.984849 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.985057 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.985150 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.985360 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.985445 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.985653 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.985740 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.986059 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.986145 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.986365 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.986449 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.986665 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.986752 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.986992 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.987081 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.987290 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.987386 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.987586 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.987672 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.987885 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.987979 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.988201 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.988294 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.988495 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.988581 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.988790 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.988884 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.989087 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.989187 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.989400 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.989485 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.989694 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.989788 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.990003 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.990165 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.990408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.990510 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.990712 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.990809 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.991032 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.991131 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.991436 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.991571 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.991737 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.991822 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.992037 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.992153 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.992349 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.992472 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.992689 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.992783 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.993005 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.993091 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.993301 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.993388 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.993605 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.993690 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.993904 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.993989 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.994216 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.994303 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.994527 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.994613 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.994828 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.994936 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.995159 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.995249 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.995455 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.995540 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.995771 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.995869 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.996082 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.996168 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.996385 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.996478 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.996695 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.996794 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.997099 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.997185 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.997412 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.997497 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.997713 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.997812 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.998027 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.998120 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.998345 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.998431 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.998641 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.998736 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.998963 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.999053 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.999268 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.999354 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.999565 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.999655 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.999862 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:09.999948 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.000176 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.000261 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.000470 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.000566 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.000823 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.000931 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.001078 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.001171 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.001380 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.001468 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.001674 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.001768 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.001968 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.002054 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.002280 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.002367 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.002575 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.002660 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.002907 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.003012 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.003219 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.003315 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.003533 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.003621 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.003847 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.003940 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.004142 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.004237 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.004455 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.004548 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.004753 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.004848 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.005049 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.005144 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.005343 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.005428 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.005637 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.005734 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.005967 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.006053 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.006264 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.006349 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.006574 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.006662 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.006919 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.007049 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.007242 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.007341 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.007544 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.007651 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.007868 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.007965 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.008209 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.008304 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.008521 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.008618 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.008821 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.008917 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.009129 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.009224 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.009440 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.009546 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.009736 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.009833 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.010030 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.010135 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.010330 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.010435 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.010621 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.010717 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.010938 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.011052 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.011238 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.011334 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.011536 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.011642 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.011840 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.011936 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.012112 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.012211 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.012405 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.012501 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.012717 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.012830 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.013011 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.013125 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.013323 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.013428 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.013620 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.013716 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.013914 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.014010 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.014210 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.014313 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.014504 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.014608 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.014831 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.014942 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.015150 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.015274 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.015466 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.015554 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.015766 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.015852 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.016084 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.016229 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.016377 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.016515 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.016684 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.016817 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.016990 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.017146 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.017291 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.017425 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.017589 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.017726 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.017893 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.018043 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.018202 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.018339 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.018501 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.018637 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.018807 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.018931 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.019143 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.019239 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.019453 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.019538 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.019952 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.020047 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.020272 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.020365 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.020578 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.020672 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.020881 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.021026 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.021182 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.021276 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.021485 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.021570 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.021787 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.021918 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.022089 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.022174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.022389 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.022476 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.022700 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.022789 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.023014 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.023102 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.023333 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.023430 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.023645 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.024256 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.024480 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.024567 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.024808 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.024904 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.025116 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.025199 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.025421 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.025523 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.025725 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.025821 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.026029 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.026115 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.026373 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.026462 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.026678 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.026765 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.027001 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.027092 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.027311 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.027411 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.027618 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.027718 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.027923 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.028080 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.028225 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.028321 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.028526 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.028621 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.028830 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.028921 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.029130 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.029296 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.029432 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.029518 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.029733 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.029819 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.030036 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.030135 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.030340 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.030433 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.030653 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.030738 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.031002 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.031141 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.031314 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.031401 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.031616 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.031710 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.031920 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.032043 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.032225 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.032319 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.032725 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.032812 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.033030 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.033117 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.033351 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.033437 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.033667 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.033761 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.033981 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.034086 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.034284 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.034370 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.034589 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.034687 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.034928 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.035020 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.035228 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.035351 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.035524 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.035623 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.035824 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.035917 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.036127 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.036221 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.036420 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.036515 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.036731 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.036818 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.037031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.037164 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.037323 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.037410 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.037629 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.037714 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.037928 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.038021 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.038442 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.038529 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.038773 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.038882 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.039108 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.039196 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.039484 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.039581 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.039804 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.039891 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.040113 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.040209 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.040411 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.040497 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.040725 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.040810 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.041023 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.041118 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.041319 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.041407 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.041626 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.041711 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.041927 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.042021 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.042222 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.042310 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.042516 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.042609 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.042817 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.042973 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.043143 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.043230 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.043448 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.043542 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.043735 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.043822 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.044028 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.044115 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.044345 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.044432 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.044641 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.044735 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.044936 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.045022 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.045232 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.045318 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.045535 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.045630 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.045827 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.045914 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.046122 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.046208 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.046418 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.046505 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.046712 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.046806 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.047040 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.047137 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.047336 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.047425 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.047637 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.047723 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.047934 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.048033 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.048237 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.048324 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.048584 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.048679 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.048886 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.048980 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.049180 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.049265 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.049494 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.049580 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.049790 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.049884 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.050084 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.050178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.050390 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.050475 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.050691 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.050789 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.051026 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.051115 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.051331 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.051428 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.051634 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.051720 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.051968 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.052053 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.052274 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.052367 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.052795 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.052884 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.053125 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.053221 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.053440 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.053527 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.053766 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.053862 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.054088 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.054174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.054388 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.054473 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.054688 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.054776 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.055519 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.055616 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.055839 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.055943 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.056143 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.056229 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.056450 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.056535 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.056751 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.056847 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.057054 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.057140 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.057352 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.057446 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.057654 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.057749 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.058205 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.058299 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.058507 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.058594 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.058808 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.058916 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.059135 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.059222 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.059434 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.059519 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.059735 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.059823 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.060035 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.060128 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.060334 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.060420 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.060638 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.060734 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.060969 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.061055 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.061279 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.061377 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.061585 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.061671 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.061891 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.061976 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.062198 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.062291 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.062499 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.062594 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.062799 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.062912 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.063124 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.063231 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.063426 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.063513 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.063730 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.063815 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.064048 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.064147 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.064352 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.064447 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.064647 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.064740 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.065284 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.065372 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.065594 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.065736 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.065906 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.066040 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.066222 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.066310 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.066526 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.066611 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.066839 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.066967 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.067176 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.067271 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.067482 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.067569 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.067794 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.067893 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.068097 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.068183 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.068417 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.068549 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.068748 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.068846 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.069066 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.069152 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.069383 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.069469 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.069681 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.069776 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.069975 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.070061 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.070269 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.070354 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.070615 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.070707 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.070958 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.071050 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.071261 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.071348 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.071555 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.071642 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.071850 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.071943 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.072148 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.072234 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.072442 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.072529 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.072735 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.072822 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.073027 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.073126 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.073320 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.073414 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.073617 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.073703 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.073909 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.074018 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.074201 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.074287 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.074492 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.074576 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.074785 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.074898 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.075105 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.075192 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.075397 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.075483 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.075695 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.075837 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.075988 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.076082 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.076278 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.076364 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.076571 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.076658 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.076863 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.076950 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.077153 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.077238 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.077473 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.077567 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.077793 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.077887 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.078098 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.078191 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.078410 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.078497 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.078711 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.078798 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.079051 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.079141 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.079356 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.079445 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.079670 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.079756 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.079983 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.080085 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.080287 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.080381 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.080588 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.080681 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.080910 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.081004 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.081211 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.081297 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.081514 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.081637 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.081817 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.081912 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.082118 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.082205 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.082419 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.082504 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.082764 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.082882 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.083066 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.083167 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.083383 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.083470 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.083682 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.083769 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.083996 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.084090 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.084304 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.084399 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.084615 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.084702 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.084921 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.085006 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.085224 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.085318 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.085545 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.085631 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.085850 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.085935 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.086645 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.086754 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.086986 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.087090 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.087292 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.087379 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.087595 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.087757 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.087905 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.087991 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.088207 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.088301 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.088512 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.088599 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.088819 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.088904 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.089124 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.089210 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.089441 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.089535 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.089756 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.089842 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.090066 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.090152 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.090383 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.090469 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.090698 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.090783 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.091060 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.091149 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.091366 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.091454 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.091699 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.091784 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.092018 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.092117 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.092323 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.092409 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.092625 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.092719 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.092923 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.093020 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:10:10.093159 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105427) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 01:10:10.093245 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105426) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 01:10:10.245238 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO dbcounter [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] Registered counter for database nova_api Sep 13 01:10:10.245437 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO dbcounter [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Registered counter for database nova_api Sep 13 01:10:10.266279 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG oslo_db.sqlalchemy.engines [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:10:10.267941 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_db.sqlalchemy.engines [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:10:10.272795 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writer thread running {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:10:10.274910 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writer thread running {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:10:10.329613 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.context [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cf926edd-6fab-4cd6-938e-882d6f32df12(cell1) {{(pid=105426) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 01:10:10.330986 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.context [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cf926edd-6fab-4cd6-938e-882d6f32df12(cell1) {{(pid=105427) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 01:10:10.333512 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG oslo_concurrency.lockutils [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:10:10.333946 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG oslo_concurrency.lockutils [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:10:10.334769 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:10:10.335259 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:10:10.335531 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG oslo_concurrency.lockutils [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:10:10.336864 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG oslo_concurrency.lockutils [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:10:10.337307 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG oslo_concurrency.lockutils [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:10:10.337866 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:10:10.338964 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:10:10.339332 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG oslo_concurrency.lockutils [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105426) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:10:10.339517 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:10:10.341333 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO dbcounter [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] Registered counter for database nova_cell0 Sep 13 01:10:10.341485 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:10:10.343492 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO dbcounter [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Registered counter for database nova_cell0 Sep 13 01:10:10.345326 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO dbcounter [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] Registered counter for database nova_cell1 Sep 13 01:10:10.347671 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO dbcounter [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Registered counter for database nova_cell1 Sep 13 01:10:10.353285 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG oslo_db.sqlalchemy.engines [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:10:10.357535 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG oslo_db.sqlalchemy.engines [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:10:10.358270 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_db.sqlalchemy.engines [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:10:10.359885 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_db.sqlalchemy.engines [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:10:10.360097 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writer thread running {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:10:10.365728 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writer thread running {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:10:10.367583 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writer thread running {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:10:10.495796 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writer thread running {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:10:10.505575 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO dbcounter [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] Registered counter for database nova_cell0 Sep 13 01:10:10.510590 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO dbcounter [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Registered counter for database nova_cell0 Sep 13 01:10:10.512242 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG oslo_db.sqlalchemy.engines [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105426) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:10:10.516916 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writer thread running {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:10:10.517566 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_db.sqlalchemy.engines [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105427) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:10:10.521878 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writer thread running {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:10:10.852319 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: WARNING keystonemiddleware.auth_token [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 01:10:10.853675 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: WARNING keystonemiddleware.auth_token [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 01:10:10.859557 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: WARNING keystonemiddleware.auth_token [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 01:10:10.860936 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: WARNING keystonemiddleware.auth_token [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 01:10:11.199463 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: WARNING keystonemiddleware.auth_token [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 01:10:11.204242 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: WARNING keystonemiddleware.auth_token [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 01:10:11.205264 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: WARNING keystonemiddleware.auth_token [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 01:10:11.210112 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: WARNING keystonemiddleware.auth_token [None req-0742cf5c-abc5-474a-875a-f8204610da79 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 01:10:11.210495 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cca731f9c0 pid: 105427 (default app) Sep 13 01:10:11.212785 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:10:11.213973 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001915 Sep 13 01:10:11.214392 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Tue Sep 13 01:10:11 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:10:11.215810 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cca731f9c0 pid: 105426 (default app) Sep 13 01:11:32.468979 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:11:32.469979 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 13 01:11:32.470383 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:11:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:11:32.482507 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_api:SELECT=3 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:32.484501 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_cell1:SELECT=3 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:32.485837 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_cell0:SELECT=3 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:32.488115 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:33.359064 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-f1753829-052e-418d-a21b-28db8b7cf922 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:11:33.392120 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-f1753829-052e-418d-a21b-28db8b7cf922 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.915092 Sep 13 01:11:33.393128 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Sep 13 01:11:32 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:11:36.034291 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:11:36.035290 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-c99ba1cf-5db2-4dca-83e3-f5c06b032cb7 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001908 Sep 13 01:11:36.035962 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:11:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:11:36.482664 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-5034b4f9-4ee9-4dc7-a431-968d864603b2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "swap": 0, "ram": 256, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "c1", "vcpus": 1}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:36.529502 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-5034b4f9-4ee9-4dc7-a431-968d864603b2 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.487359 Sep 13 01:11:36.530065 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 01:11:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:11:36.751985 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-d4557374-f871-4f18-ae97-ffc25f074841 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:36.758977 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_api:SELECT=3 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:36.759989 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_cell1:SELECT=3 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:36.760689 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_cell0:SELECT=3 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:36.761387 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:11:36.824559 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-d4557374-f871-4f18-ae97-ffc25f074841 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.285380 Sep 13 01:11:36.825377 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Sep 13 01:11:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:11:39.440728 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-5034b4f9-4ee9-4dc7-a431-968d864603b2 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:11:39.441743 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-5034b4f9-4ee9-4dc7-a431-968d864603b2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 13 01:11:39.442146 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:11:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:11:40.098301 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-508746a0-c22a-4822-bf75-7cf107e44c71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "name": "ds512M", "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:40.139774 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-508746a0-c22a-4822-bf75-7cf107e44c71 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.691402 Sep 13 01:11:40.140540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 01:11:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 01:11:40.152834 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-a8545be0-fea1-4a9d-9c8b-ee9019548b96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:40.194046 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-a8545be0-fea1-4a9d-9c8b-ee9019548b96 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044840 Sep 13 01:11:40.195213 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Sep 13 01:11:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:11:42.836236 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-508746a0-c22a-4822-bf75-7cf107e44c71 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:11:42.837265 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-508746a0-c22a-4822-bf75-7cf107e44c71 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 13 01:11:42.837682 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:11:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:11:43.251523 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-38ec7fc9-9971-4d53-8d4e-d1e9f8378b02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "ram": 1024, "name": "ds1G", "disk": 10, "vcpus": 1}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:43.271783 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-38ec7fc9-9971-4d53-8d4e-d1e9f8378b02 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.427144 Sep 13 01:11:43.272460 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 01:11:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:11:43.285133 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-ef01a95d-53ed-40dc-9002-f765891c3a05 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:43.315018 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-ef01a95d-53ed-40dc-9002-f765891c3a05 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033986 Sep 13 01:11:43.315683 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Sep 13 01:11:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:11:45.932056 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-38ec7fc9-9971-4d53-8d4e-d1e9f8378b02 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:11:45.933706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-38ec7fc9-9971-4d53-8d4e-d1e9f8378b02 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002076 Sep 13 01:11:45.934108 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:11:45 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:11:46.348138 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-9626d876-33af-49a9-939a-75e439fb43be admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "ram": 2048, "id": "d3"}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:46.369690 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-9626d876-33af-49a9-939a-75e439fb43be admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.426749 Sep 13 01:11:46.370515 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 01:11:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:11:46.382602 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-c3585ca6-c742-4df9-903c-fcd5ebb6d4d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:46.415008 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-c3585ca6-c742-4df9-903c-fcd5ebb6d4d8 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035885 Sep 13 01:11:46.415753 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Sep 13 01:11:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:11:49.077607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-9626d876-33af-49a9-939a-75e439fb43be admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:11:49.078615 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-9626d876-33af-49a9-939a-75e439fb43be admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 13 01:11:49.079093 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:11:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:11:49.527984 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-aa1c62af-30f2-4d7f-9294-2dec1ec3d566 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d4", "disk": 20}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:49.547637 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-aa1c62af-30f2-4d7f-9294-2dec1ec3d566 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.462486 Sep 13 01:11:49.548733 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 01:11:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:11:49.561276 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-a0558e1f-55a1-489c-b608-6e806e5d186a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:49.589875 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-a0558e1f-55a1-489c-b608-6e806e5d186a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031995 Sep 13 01:11:49.590612 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Tue Sep 13 01:11:49 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:11:52.883094 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-aa1c62af-30f2-4d7f-9294-2dec1ec3d566 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:11:52.884589 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-aa1c62af-30f2-4d7f-9294-2dec1ec3d566 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002065 Sep 13 01:11:52.885065 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:11:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:11:53.311853 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-bbac3a13-98ae-4a06-89b2-925d14beb71b admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:11:53.336746 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-bbac3a13-98ae-4a06-89b2-925d14beb71b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.445767 Sep 13 01:11:53.337274 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Sep 13 01:11:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:11:55.926708 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-aa1c62af-30f2-4d7f-9294-2dec1ec3d566 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:11:55.927824 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-aa1c62af-30f2-4d7f-9294-2dec1ec3d566 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Sep 13 01:11:55.928225 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:11:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:11:56.339121 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-dba97da4-6826-4b09-acd6-62533efeeaca admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "rxtx_factor": 1.0, "disk": 1, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny"}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:56.358396 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-dba97da4-6826-4b09-acd6-62533efeeaca admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.423850 Sep 13 01:11:56.359042 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 01:11:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:11:56.371482 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-1bb00a86-6e3b-4bd6-b1ac-3fe1c16cc083 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:56.398800 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-1bb00a86-6e3b-4bd6-b1ac-3fe1c16cc083 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030895 Sep 13 01:11:56.399602 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Sep 13 01:11:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:11:59.220090 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-dba97da4-6826-4b09-acd6-62533efeeaca admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:11:59.221678 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-dba97da4-6826-4b09-acd6-62533efeeaca admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002074 Sep 13 01:11:59.222236 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:11:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:11:59.630565 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-ec078521-5527-43ac-a094-8117daf1b985 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:59.652717 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-ec078521-5527-43ac-a094-8117daf1b985 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.424313 Sep 13 01:11:59.653513 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 01:11:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:11:59.671480 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-41d0adc6-b552-45bd-a5bd-3faec94917ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:11:59.699183 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-41d0adc6-b552-45bd-a5bd-3faec94917ed admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034012 Sep 13 01:11:59.699870 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Sep 13 01:11:59 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:12:02.749232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-ec078521-5527-43ac-a094-8117daf1b985 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:02.750241 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-ec078521-5527-43ac-a094-8117daf1b985 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 13 01:12:02.751205 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:12:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:12:03.192480 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-fd6a2a2c-2572-45ac-b8b7-1e91c56f44a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "3", "vcpus": 2, "disk": 40}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:12:03.215722 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-fd6a2a2c-2572-45ac-b8b7-1e91c56f44a4 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.456801 Sep 13 01:12:03.216443 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 01:12:02 2022] POST /compute/v2.1/flavors => generated 406 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:12:03.229078 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-e922f744-d35d-4651-9319-e654f2ff88f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:12:03.234422 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:03.258367 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-e922f744-d35d-4651-9319-e654f2ff88f2 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033081 Sep 13 01:12:03.258986 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Sep 13 01:12:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:12:05.882224 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-fd6a2a2c-2572-45ac-b8b7-1e91c56f44a4 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:05.883281 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-fd6a2a2c-2572-45ac-b8b7-1e91c56f44a4 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 Sep 13 01:12:05.883895 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:12:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:12:06.333515 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-81851684-7464-42b2-9507-c091c0c81539 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "swap": 0, "id": "4", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 8192, "disk": 80}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:12:06.356743 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-81851684-7464-42b2-9507-c091c0c81539 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.466848 Sep 13 01:12:06.357386 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 01:12:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:12:06.369196 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-17927e5d-8f3d-4368-835b-5f141ca39180 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:12:06.395000 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-17927e5d-8f3d-4368-835b-5f141ca39180 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029383 Sep 13 01:12:06.395999 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Sep 13 01:12:06 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:12:08.998377 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-81851684-7464-42b2-9507-c091c0c81539 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:08.999459 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-81851684-7464-42b2-9507-c091c0c81539 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Sep 13 01:12:09.000674 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:12:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:12:09.442495 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-1f57fcb6-b7e2-4743-983a-a8dbb27f4c46 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "ram": 16384, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:12:09.448713 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:09.466102 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-1f57fcb6-b7e2-4743-983a-a8dbb27f4c46 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.459459 Sep 13 01:12:09.466759 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Tue Sep 13 01:12:09 2022] POST /compute/v2.1/flavors => generated 408 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 01:12:09.479265 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-c5aad720-90df-41d8-9aac-47e24c4c7b30 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:12:09.506147 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-c5aad720-90df-41d8-9aac-47e24c4c7b30 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030291 Sep 13 01:12:09.507299 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Tue Sep 13 01:12:09 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:12:25.347006 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-1f57fcb6-b7e2-4743-983a-a8dbb27f4c46 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:25.348010 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-1f57fcb6-b7e2-4743-983a-a8dbb27f4c46 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Sep 13 01:12:25.348409 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:12:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:12:25.359444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:12:25.740331 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-f1505aa1-a17d-42e4-afa2-04839d9bcf6b admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:25.758474 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-f1505aa1-a17d-42e4-afa2-04839d9bcf6b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.404052 Sep 13 01:12:25.759016 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Sep 13 01:12:25 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:12:27.080824 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-1f57fcb6-b7e2-4743-983a-a8dbb27f4c46 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:27.081825 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-1f57fcb6-b7e2-4743-983a-a8dbb27f4c46 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Sep 13 01:12:27.082221 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 01:12:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:12:27.596445 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-ba93883c-079e-4cb0-891d-9875c29eb954 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:27.601672 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.wsgi [None req-ba93883c-079e-4cb0-891d-9875c29eb954 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-ba93883c-079e-4cb0-891d-9875c29eb954 admin admin] Request method failure captured: Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Accept: application/json Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Accept-Encoding: gzip, deflate Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Connection: keep-alive Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Content-Length: 0 Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Host: 10.222.0.15 Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Openstack-Api-Version: compute 2.92 Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Openstack-System-Scope: None Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: User-Agent: python-novaclient Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Auth-Token: gAAAAABjH9j62Xt4FNfc9RSrBsrCJzxd_Mq8sGAxpGbq9SALLiPHejF0bnkK7jU_objfcux43pKrPLn9JIC4X8pkG4dVoeRZq2O_CSKPSqoxRo5bx_uWMrtOYn_uDoWCxUJA_IHU7SkKUIJAJnvgOyVr8tnxCD4zuSmCTM1qz-l-T6WrMAxmO3c Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Domain-Id: None Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Domain-Name: None Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Identity-Status: Confirmed Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Is-Admin-Project: True Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Project-Domain-Id: default Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Project-Domain-Name: Default Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Project-Id: ce37ba2e4948471599c41255ecf54622 Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Project-Name: admin Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Role: admin,reader,member Sep 13 01:12:27.604949 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Roles: admin,reader,member Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce37ba2e4948471599c41255ecf54622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce37ba2e4948471599c41255ecf54622"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce37ba2e4948471599c41255ecf54622"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce37ba2e4948471599c41255ecf54622"}]}] Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Tenant: admin Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Tenant-Id: ce37ba2e4948471599c41255ecf54622 Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Tenant-Name: admin Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User: admin Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User-Domain-Id: default Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User-Domain-Name: Default Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User-Id: 22ddb5151c0f4696a4f99a9acc8804ea Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User-Name: admin Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: method: > Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: exception: Flavor 42 could not be found. Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: action_args: {'id': '42'} Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:12:27.606579 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:12:27.607870 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:27.609232 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-ba93883c-079e-4cb0-891d-9875c29eb954 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:12:27.610493 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-ba93883c-079e-4cb0-891d-9875c29eb954 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.386689 Sep 13 01:12:27.610493 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Sep 13 01:12:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:27.616035 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-10f650ff-7dd5-4fcd-bfcc-fd0a4b8cfb45 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:27.638794 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-10f650ff-7dd5-4fcd-bfcc-fd0a4b8cfb45 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026331 Sep 13 01:12:27.640016 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Sep 13 01:12:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:12:27.650682 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-307d1d88-0fc6-4913-ab0f-4677b0e35ffb admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:27.672129 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-307d1d88-0fc6-4913-ab0f-4677b0e35ffb admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026009 Sep 13 01:12:27.672646 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Sep 13 01:12:27 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:12:27.682015 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-7d0bfc58-21b8-4f52-9fcc-c8cbcdaeed0e admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:27.687831 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.wsgi [None req-7d0bfc58-21b8-4f52-9fcc-c8cbcdaeed0e admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-7d0bfc58-21b8-4f52-9fcc-c8cbcdaeed0e admin admin] Request method failure captured: Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Accept: application/json Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Accept-Encoding: gzip, deflate Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Connection: keep-alive Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Content-Length: 0 Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Host: 10.222.0.15 Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Openstack-Api-Version: compute 2.92 Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Openstack-System-Scope: None Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: User-Agent: python-novaclient Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Auth-Token: gAAAAABjH9j62Xt4FNfc9RSrBsrCJzxd_Mq8sGAxpGbq9SALLiPHejF0bnkK7jU_objfcux43pKrPLn9JIC4X8pkG4dVoeRZq2O_CSKPSqoxRo5bx_uWMrtOYn_uDoWCxUJA_IHU7SkKUIJAJnvgOyVr8tnxCD4zuSmCTM1qz-l-T6WrMAxmO3c Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Domain-Id: None Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Domain-Name: None Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Identity-Status: Confirmed Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Is-Admin-Project: True Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Project-Domain-Id: default Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Project-Domain-Name: Default Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Project-Id: ce37ba2e4948471599c41255ecf54622 Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Project-Name: admin Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Role: admin,reader,member Sep 13 01:12:27.691104 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Roles: admin,reader,member Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce37ba2e4948471599c41255ecf54622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce37ba2e4948471599c41255ecf54622"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce37ba2e4948471599c41255ecf54622"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce37ba2e4948471599c41255ecf54622"}]}] Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Tenant: admin Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Tenant-Id: ce37ba2e4948471599c41255ecf54622 Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Tenant-Name: admin Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User: admin Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User-Domain-Id: default Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User-Domain-Name: Default Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User-Id: 22ddb5151c0f4696a4f99a9acc8804ea Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User-Name: admin Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: method: > Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: exception: Flavor 42 could not be found. Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: action_args: {'id': '42'} Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:12:27.692549 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:12:27.693384 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:27.694607 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-7d0bfc58-21b8-4f52-9fcc-c8cbcdaeed0e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:12:27.695807 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-7d0bfc58-21b8-4f52-9fcc-c8cbcdaeed0e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014280 Sep 13 01:12:27.695807 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Sep 13 01:12:27 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:28.905750 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-307d1d88-0fc6-4913-ab0f-4677b0e35ffb admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:28.906780 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-307d1d88-0fc6-4913-ab0f-4677b0e35ffb admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002051 Sep 13 01:12:28.907204 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 01:12:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:12:29.422671 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-6aad584d-bf6d-4f27-9d97-965c3763bec9 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:29.427846 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.wsgi [None req-6aad584d-bf6d-4f27-9d97-965c3763bec9 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-6aad584d-bf6d-4f27-9d97-965c3763bec9 admin admin] Request method failure captured: Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Accept: application/json Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Accept-Encoding: gzip, deflate Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Connection: keep-alive Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Content-Length: 0 Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Host: 10.222.0.15 Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Openstack-Api-Version: compute 2.92 Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Openstack-System-Scope: None Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: User-Agent: python-novaclient Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Auth-Token: gAAAAABjH9j8GbpLKkAEJyhc5np36ONsD986E17TVDA1LtpOu_y9DiSBD1ZFKJdXEsefPrmQsHuAZM78cW0fLk0YTFqNbjC_5UvCDODGcSWI8PlOowcqAV9dBC6VOlj9MiCB2IDS7o7efZho318C7Am2kfNFvgvLK2uNsiUUaW63rX3cnk_owic Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Domain-Id: None Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Domain-Name: None Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Identity-Status: Confirmed Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Is-Admin-Project: True Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Project-Domain-Id: default Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Project-Domain-Name: Default Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Project-Id: ce37ba2e4948471599c41255ecf54622 Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Project-Name: admin Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Role: admin,reader,member Sep 13 01:12:29.429629 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Roles: admin,reader,member Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce37ba2e4948471599c41255ecf54622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce37ba2e4948471599c41255ecf54622"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce37ba2e4948471599c41255ecf54622"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce37ba2e4948471599c41255ecf54622"}]}] Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Tenant: admin Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Tenant-Id: ce37ba2e4948471599c41255ecf54622 Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Tenant-Name: admin Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User: admin Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User-Domain-Id: default Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User-Domain-Name: Default Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User-Id: 22ddb5151c0f4696a4f99a9acc8804ea Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User-Name: admin Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: method: > Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: exception: Flavor 84 could not be found. Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: action_args: {'id': '84'} Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:12:29.431178 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:12:29.433174 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:29.434627 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-6aad584d-bf6d-4f27-9d97-965c3763bec9 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:12:29.435899 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-6aad584d-bf6d-4f27-9d97-965c3763bec9 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.387319 Sep 13 01:12:29.435899 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Sep 13 01:12:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:29.440723 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-38aedc6a-a0f2-4e90-8765-26bad0ff6d93 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:29.457120 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-38aedc6a-a0f2-4e90-8765-26bad0ff6d93 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019803 Sep 13 01:12:29.457726 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Sep 13 01:12:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:12:29.468577 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-356432ee-5555-460a-a713-50d32e555911 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:29.484131 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-356432ee-5555-460a-a713-50d32e555911 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019886 Sep 13 01:12:29.484666 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Sep 13 01:12:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:12:29.494004 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-e316f1da-d237-4426-bc2b-0eee99886155 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:29.498968 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.wsgi [None req-e316f1da-d237-4426-bc2b-0eee99886155 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-e316f1da-d237-4426-bc2b-0eee99886155 admin admin] Request method failure captured: Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Accept: application/json Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Accept-Encoding: gzip, deflate Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Connection: keep-alive Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Content-Length: 0 Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Host: 10.222.0.15 Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Openstack-Api-Version: compute 2.92 Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Openstack-System-Scope: None Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: User-Agent: python-novaclient Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Auth-Token: gAAAAABjH9j8GbpLKkAEJyhc5np36ONsD986E17TVDA1LtpOu_y9DiSBD1ZFKJdXEsefPrmQsHuAZM78cW0fLk0YTFqNbjC_5UvCDODGcSWI8PlOowcqAV9dBC6VOlj9MiCB2IDS7o7efZho318C7Am2kfNFvgvLK2uNsiUUaW63rX3cnk_owic Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Domain-Id: None Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Domain-Name: None Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Identity-Status: Confirmed Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Is-Admin-Project: True Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Project-Domain-Id: default Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Project-Domain-Name: Default Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Project-Id: ce37ba2e4948471599c41255ecf54622 Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Project-Name: admin Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Role: admin,reader,member Sep 13 01:12:29.500444 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Roles: admin,reader,member Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce37ba2e4948471599c41255ecf54622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce37ba2e4948471599c41255ecf54622"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce37ba2e4948471599c41255ecf54622"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce37ba2e4948471599c41255ecf54622"}]}] Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Tenant: admin Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Tenant-Id: ce37ba2e4948471599c41255ecf54622 Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Tenant-Name: admin Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User: admin Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User-Domain-Id: default Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User-Domain-Name: Default Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User-Id: 22ddb5151c0f4696a4f99a9acc8804ea Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User-Name: admin Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: method: > Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: exception: Flavor 84 could not be found. Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: action_args: {'id': '84'} Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:12:29.502069 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:12:29.503408 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:29.504801 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-e316f1da-d237-4426-bc2b-0eee99886155 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:12:29.506022 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-e316f1da-d237-4426-bc2b-0eee99886155 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011314 Sep 13 01:12:29.506022 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Tue Sep 13 01:12:29 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 13 01:12:30.719657 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-356432ee-5555-460a-a713-50d32e555911 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:30.720664 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-356432ee-5555-460a-a713-50d32e555911 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 13 01:12:30.721064 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 01:12:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:12:31.246095 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-fa5d5ba2-1eb3-42fc-b243-6c078d1a2fa7 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:31.252526 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.wsgi [None req-fa5d5ba2-1eb3-42fc-b243-6c078d1a2fa7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-fa5d5ba2-1eb3-42fc-b243-6c078d1a2fa7 admin admin] Request method failure captured: Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Accept: application/json Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Accept-Encoding: gzip, deflate Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Connection: keep-alive Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Content-Length: 0 Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Host: 10.222.0.15 Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Openstack-Api-Version: compute 2.92 Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Openstack-System-Scope: None Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: User-Agent: python-novaclient Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Auth-Token: gAAAAABjH9j-ofPiJ7eIwxB2W-JhTwLwpLlSu82l_N0Vp5xM_f4U_7s8QwaSpIX2NfTpkM4cNlthRgh5DHAhue8KZQxPn3pxSbjiWQBpeo6-Wv4hnkxCNBQic0_d4tNSNDVuVD7crCKuEtD4NCBKPQq8nIo-Ss9SSb6wxGh4UPnkMZveRdw5V9g Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Domain-Id: None Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Domain-Name: None Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Identity-Status: Confirmed Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Is-Admin-Project: True Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Project-Domain-Id: default Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Project-Domain-Name: Default Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Project-Id: ce37ba2e4948471599c41255ecf54622 Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Project-Name: admin Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Role: admin,reader,member Sep 13 01:12:31.254031 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Roles: admin,reader,member Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce37ba2e4948471599c41255ecf54622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce37ba2e4948471599c41255ecf54622"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce37ba2e4948471599c41255ecf54622"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce37ba2e4948471599c41255ecf54622"}]}] Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Tenant: admin Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Tenant-Id: ce37ba2e4948471599c41255ecf54622 Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-Tenant-Name: admin Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User: admin Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User-Domain-Id: default Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User-Domain-Name: Default Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User-Id: 22ddb5151c0f4696a4f99a9acc8804ea Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: X-User-Name: admin Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: method: > Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: exception: Flavor 451 could not be found. Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: action_args: {'id': '451'} Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:12:31.255676 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:12:31.256706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: ERROR nova.api.openstack.wsgi Sep 13 01:12:31.258032 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-fa5d5ba2-1eb3-42fc-b243-6c078d1a2fa7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105426) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:12:31.259370 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-fa5d5ba2-1eb3-42fc-b243-6c078d1a2fa7 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.398339 Sep 13 01:12:31.259370 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Sep 13 01:12:30 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:31.265793 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-eaac424e-e72d-4a82-9e5d-d1581621592b admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:31.282648 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-eaac424e-e72d-4a82-9e5d-d1581621592b admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020881 Sep 13 01:12:31.283230 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Sep 13 01:12:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:12:31.293824 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:31.308828 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018589 Sep 13 01:12:31.309357 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Tue Sep 13 01:12:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:12:31.319152 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-6b365b6c-d45f-427d-9ed2-5f4155cdaaaa admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:31.324063 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.wsgi [None req-6b365b6c-d45f-427d-9ed2-5f4155cdaaaa admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-6b365b6c-d45f-427d-9ed2-5f4155cdaaaa admin admin] Request method failure captured: Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Accept: application/json Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Accept-Encoding: gzip, deflate Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Connection: keep-alive Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Content-Length: 0 Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Host: 10.222.0.15 Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Openstack-Api-Version: compute 2.92 Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Openstack-System-Scope: None Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: User-Agent: python-novaclient Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Auth-Token: gAAAAABjH9j-ofPiJ7eIwxB2W-JhTwLwpLlSu82l_N0Vp5xM_f4U_7s8QwaSpIX2NfTpkM4cNlthRgh5DHAhue8KZQxPn3pxSbjiWQBpeo6-Wv4hnkxCNBQic0_d4tNSNDVuVD7crCKuEtD4NCBKPQq8nIo-Ss9SSb6wxGh4UPnkMZveRdw5V9g Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Domain-Id: None Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Domain-Name: None Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Identity-Status: Confirmed Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Is-Admin-Project: True Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Openstack-Nova-Api-Version: 2.92 Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Project-Domain-Id: default Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Project-Domain-Name: Default Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Project-Id: ce37ba2e4948471599c41255ecf54622 Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Project-Name: admin Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Role: admin,reader,member Sep 13 01:12:31.325540 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Roles: admin,reader,member Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_ce37ba2e4948471599c41255ecf54622"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce37ba2e4948471599c41255ecf54622"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/ce37ba2e4948471599c41255ecf54622"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/ce37ba2e4948471599c41255ecf54622"}]}] Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Tenant: admin Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Tenant-Id: ce37ba2e4948471599c41255ecf54622 Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-Tenant-Name: admin Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User: admin Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User-Domain-Id: default Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User-Domain-Name: Default Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User-Id: 22ddb5151c0f4696a4f99a9acc8804ea Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: X-User-Name: admin Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: method: > Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: exception: Flavor 451 could not be found. Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: action_args: {'id': '451'} Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:12:31.327902 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:12:31.328872 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: ERROR nova.api.openstack.wsgi Sep 13 01:12:31.330195 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-6b365b6c-d45f-427d-9ed2-5f4155cdaaaa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105427) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:12:31.331513 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-6b365b6c-d45f-427d-9ed2-5f4155cdaaaa admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011239 Sep 13 01:12:31.331513 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Sep 13 01:12:31 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 13 01:12:32.549962 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:32.550986 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Sep 13 01:12:32.551374 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 01:12:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:12:33.074977 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-8b0994ce-fc86-4bd9-943f-1ad0af1a3e93 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:12:33.095157 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-8b0994ce-fc86-4bd9-943f-1ad0af1a3e93 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.406803 Sep 13 01:12:33.095692 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Sep 13 01:12:32 2022] POST /compute/v2.1/flavors => generated 404 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:12:34.329818 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:34.330885 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Sep 13 01:12:34.331274 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 01:12:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:12:34.859402 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-b7789f3f-dff2-4225-ad10-b90fa27e4d6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:12:34.878207 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-b7789f3f-dff2-4225-ad10-b90fa27e4d6a admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.410239 Sep 13 01:12:34.878808 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Sep 13 01:12:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:12:36.088220 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:36.089234 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 13 01:12:36.089634 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 01:12:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:12:36.616782 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-c732c56c-0484-4e2b-ad17-aeb607f51ef4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:12:36.634956 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-c732c56c-0484-4e2b-ad17-aeb607f51ef4 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.406773 Sep 13 01:12:36.635476 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Sep 13 01:12:36 2022] POST /compute/v2.1/flavors => generated 407 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 01:12:37.844706 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:37.845705 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001412 Sep 13 01:12:37.846089 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 01:12:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:12:38.372689 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-2e6abda3-adcd-450b-90ad-c58687fa11b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:12:38.391459 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-2e6abda3-adcd-450b-90ad-c58687fa11b9 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.408763 Sep 13 01:12:38.391997 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Tue Sep 13 01:12:37 2022] POST /compute/v2.1/flavors => generated 409 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:12:39.605538 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:39.606574 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Sep 13 01:12:39.607012 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 01:12:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:12:40.121939 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-d379a626-4d4a-4301-b678-6eab23d9d84a admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:12:40.144332 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-d379a626-4d4a-4301-b678-6eab23d9d84a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401463 Sep 13 01:12:40.144862 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Tue Sep 13 01:12:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:13:36.448036 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:13:36.449087 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-c25262f4-32ae-4e00-ad2f-28e292217d0e admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001523 Sep 13 01:13:36.449526 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Tue Sep 13 01:13:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:13:36.460115 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:36.838265 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-8f2bba06-3dc9-42df-a52a-0400041a485a admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:13:36.859110 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-8f2bba06-3dc9-42df-a52a-0400041a485a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403426 Sep 13 01:13:36.859650 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Tue Sep 13 01:13:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:13:36.880420 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_api:SELECT=14 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:13:36.884451 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-a39e91ed-f177-4f1e-98db-e051426f37f0 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:13:36.892167 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-a39e91ed-f177-4f1e-98db-e051426f37f0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012742 Sep 13 01:13:36.892675 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Tue Sep 13 01:13:36 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:13:36.904439 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-7502b658-ccb4-4df9-9874-241b41842ca7 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:13:36.912161 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-7502b658-ccb4-4df9-9874-241b41842ca7 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011235 Sep 13 01:13:36.912665 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Tue Sep 13 01:13:36 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:13:36.923643 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-4bd43698-3d8f-472c-b0b3-04e601e80068 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:13:36.930675 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-4bd43698-3d8f-472c-b0b3-04e601e80068 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010465 Sep 13 01:13:36.931223 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Tue Sep 13 01:13:36 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:13:36.942455 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-e35b9828-846b-4ab6-824d-637921207380 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:13:36.949410 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-e35b9828-846b-4ab6-824d-637921207380 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010494 Sep 13 01:13:36.949916 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Tue Sep 13 01:13:36 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:16:37.673742 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-4bd43698-3d8f-472c-b0b3-04e601e80068 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:16:37.674769 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-4bd43698-3d8f-472c-b0b3-04e601e80068 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 13 01:16:37.675188 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 01:16:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:16:37.818793 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_api:SELECT=6 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:16:37.976696 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-69373a80-6a58-4f75-9faf-3581084e2eb8 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:16:37.981398 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-69373a80-6a58-4f75-9faf-3581084e2eb8 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:16:37.981869 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-69373a80-6a58-4f75-9faf-3581084e2eb8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:16:37.982290 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-69373a80-6a58-4f75-9faf-3581084e2eb8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:16:37.983042 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-69373a80-6a58-4f75-9faf-3581084e2eb8 admin admin] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:16:37.983472 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-69373a80-6a58-4f75-9faf-3581084e2eb8 admin admin] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:16:37.983881 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-69373a80-6a58-4f75-9faf-3581084e2eb8 admin admin] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:16:38.015824 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-69373a80-6a58-4f75-9faf-3581084e2eb8 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.198300 Sep 13 01:16:38.016366 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Sep 13 01:16:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:16:39.114530 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-4bd43698-3d8f-472c-b0b3-04e601e80068 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:16:39.115590 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-4bd43698-3d8f-472c-b0b3-04e601e80068 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 13 01:16:39.126638 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 01:16:39 2022] GET /compute/v2.1 => generated 388 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:16:39.304355 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-48a8fe08-27b2-48e6-bd55-e89a13613591 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:16:39.307838 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-48a8fe08-27b2-48e6-bd55-e89a13613591 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:16:39.308315 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-48a8fe08-27b2-48e6-bd55-e89a13613591 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:16:39.308744 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-48a8fe08-27b2-48e6-bd55-e89a13613591 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:16:39.309456 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-48a8fe08-27b2-48e6-bd55-e89a13613591 admin admin] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:16:39.309905 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-48a8fe08-27b2-48e6-bd55-e89a13613591 admin admin] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:16:39.310324 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-48a8fe08-27b2-48e6-bd55-e89a13613591 admin admin] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:16:39.330260 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-48a8fe08-27b2-48e6-bd55-e89a13613591 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.075015 Sep 13 01:16:39.330811 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Sep 13 01:16:39 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:16:50.808722 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-4bd43698-3d8f-472c-b0b3-04e601e80068 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:16:50.809729 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-4bd43698-3d8f-472c-b0b3-04e601e80068 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 13 01:16:50.810123 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 01:16:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:16:50.953511 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_cell0:SELECT=4 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:16:50.954219 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_cell1:SELECT=4 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:16:50.954865 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG dbcounter [-] [105427] Writing DB stats nova_api:SELECT=8 {{(pid=105427) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:16:51.002631 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-6ab70a62-2365-41aa-97d3-e9e93d63cbfc admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:16:51.006012 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-6ab70a62-2365-41aa-97d3-e9e93d63cbfc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:16:51.006482 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-6ab70a62-2365-41aa-97d3-e9e93d63cbfc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:16:51.006929 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-6ab70a62-2365-41aa-97d3-e9e93d63cbfc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:16:51.007630 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-6ab70a62-2365-41aa-97d3-e9e93d63cbfc admin admin] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:16:51.008070 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-6ab70a62-2365-41aa-97d3-e9e93d63cbfc admin admin] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:16:51.008481 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-6ab70a62-2365-41aa-97d3-e9e93d63cbfc admin admin] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:16:51.033714 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-6ab70a62-2365-41aa-97d3-e9e93d63cbfc admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.084642 Sep 13 01:16:51.034169 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Sep 13 01:16:50 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:16:52.114099 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG nova.api.openstack.wsgi [None req-4bd43698-3d8f-472c-b0b3-04e601e80068 admin admin] Calling method '>' {{(pid=105426) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:16:52.115124 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: INFO nova.api.openstack.requestlog [None req-4bd43698-3d8f-472c-b0b3-04e601e80068 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001406 Sep 13 01:16:52.115518 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: [pid: 105426|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Tue Sep 13 01:16:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:16:52.307310 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG nova.api.openstack.wsgi [None req-d12c6e19-06f9-4d4f-9dcf-136ffe004700 admin admin] Calling method '>' {{(pid=105427) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:16:52.310603 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-d12c6e19-06f9-4d4f-9dcf-136ffe004700 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:16:52.311362 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-d12c6e19-06f9-4d4f-9dcf-136ffe004700 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:16:52.311782 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-d12c6e19-06f9-4d4f-9dcf-136ffe004700 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:16:52.312487 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-d12c6e19-06f9-4d4f-9dcf-136ffe004700 admin admin] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:16:52.312929 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-d12c6e19-06f9-4d4f-9dcf-136ffe004700 admin admin] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:16:52.313337 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: DEBUG oslo_concurrency.lockutils [None req-d12c6e19-06f9-4d4f-9dcf-136ffe004700 admin admin] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105427) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:16:52.334357 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: INFO nova.api.openstack.requestlog [None req-d12c6e19-06f9-4d4f-9dcf-136ffe004700 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.079363 Sep 13 01:16:52.334828 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: [pid: 105427|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Tue Sep 13 01:16:52 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:17:49.117801 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: Tue Sep 13 01:17:49 2022 - graceful shutdown triggered... Sep 13 01:17:49.117310 dv-cinder-856941-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 13 01:17:49.118776 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: Gracefully killing worker 1 (pid: 105426)... Sep 13 01:17:49.119316 dv-cinder-856941-3-iscsi devstack@n-api.service[105427]: Gracefully killing worker 2 (pid: 105427)... Sep 13 01:17:49.243857 dv-cinder-856941-3-iscsi devstack@n-api.service[105426]: DEBUG dbcounter [-] [105426] Writing DB stats nova_api:SELECT=4 {{(pid=105426) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:17:50.118195 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: worker 1 buried after 1 seconds Sep 13 01:17:50.118747 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: worker 2 buried after 1 seconds Sep 13 01:17:50.118747 dv-cinder-856941-3-iscsi devstack@n-api.service[105425]: goodbye to uWSGI. Sep 13 01:17:50.119827 dv-cinder-856941-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 13 01:17:50.120380 dv-cinder-856941-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 13 01:17:50.123143 dv-cinder-856941-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 13 01:17:50.132959 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 13 01:17:50.134979 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 01:17:50 2022] *** Sep 13 01:17:50.134979 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 01:17:50.134979 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 01:17:50.134979 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: nodename: dv-cinder-856941-3-iscsi Sep 13 01:17:50.134979 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: machine: x86_64 Sep 13 01:17:50.134979 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: clock source: unix Sep 13 01:17:50.134979 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: pcre jit disabled Sep 13 01:17:50.134979 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: detected number of CPU cores: 4 Sep 13 01:17:50.134979 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: current working directory: / Sep 13 01:17:50.134979 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: detected binary path: /usr/bin/uwsgi-core Sep 13 01:17:50.135735 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: your processes number limit is 47680 Sep 13 01:17:50.135735 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: your memory page size is 4096 bytes Sep 13 01:17:50.135735 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: detected max file descriptor number: 2048 Sep 13 01:17:50.135735 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: lock engine: pthread robust mutexes Sep 13 01:17:50.135735 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: thunder lock: enabled Sep 13 01:17:50.135735 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 13 01:17:50.135735 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 01:17:50.178065 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: Python main interpreter initialized at 0x558c7ab1a9c0 Sep 13 01:17:50.178065 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: python threads support enabled Sep 13 01:17:50.178065 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: your server socket listen backlog is limited to 100 connections Sep 13 01:17:50.178065 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: your mercy for graceful operations on workers is 90 seconds Sep 13 01:17:50.178065 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 01:17:50.178065 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: *** Operational MODE: preforking *** Sep 13 01:17:50.180791 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: *** uWSGI is running in multiple interpreter mode *** Sep 13 01:17:50.180791 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: spawned uWSGI master process (pid: 120396) Sep 13 01:17:50.180791 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: spawned uWSGI worker 1 (pid: 120412, cores: 1) Sep 13 01:17:50.180791 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: spawned uWSGI worker 2 (pid: 120415, cores: 1) Sep 13 01:17:50.180791 dv-cinder-856941-3-iscsi devstack@n-api.service[120396]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 01:17:50.178532 dv-cinder-856941-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 13 01:17:50.844090 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 01:17:50.845004 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 13 01:17:51.996419 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 01:17:51.996419 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: from cryptography.utils import int_from_bytes Sep 13 01:17:51.997024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 01:17:51.997024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: from cryptography.utils import int_from_bytes Sep 13 01:17:52.002633 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 01:17:52.002633 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: from cryptography.utils import int_from_bytes Sep 13 01:17:52.003154 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 01:17:52.003154 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: from cryptography.utils import int_from_bytes Sep 13 01:17:54.402978 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 01:17:54.403574 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 01:17:54.403574 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 01:17:54.403940 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 01:17:54.406445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 01:17:54.406445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.406445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.406445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.406445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.406445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.406445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.406445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.407080 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.407080 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.407392 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.407589 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.408106 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856941-3-iscsi {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.408431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.408739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.409049 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.410992 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.410992 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.410992 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.410992 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.410992 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.412064 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 01:17:54.412480 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 01:17:54.412565 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.412645 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.412720 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 01:17:54.412916 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.413037 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 01:17:54.413403 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 01:17:54.413527 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.413611 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.413680 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.413871 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.413990 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.414340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.414463 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.414545 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.414623 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.414800 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.415038 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.415256 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.415472 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.415472 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.415880 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856941-3-iscsi {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.416300 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.417104 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.417413 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.417883 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.418305 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.418527 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.418750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.418983 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.419211 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-856941-3-iscsi {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.419424 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.419424 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.419819 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.420025 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.420215 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.420369 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.420513 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.420693 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.420851 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.420994 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.421135 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.421317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.421472 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.421621 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.421777 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.421938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.422107 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.422265 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.422415 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.422570 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.422781 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.422964 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.423125 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.423270 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.423411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.423559 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.423717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.423879 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.423879 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.424157 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.424303 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.424458 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.424611 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.426985 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.427846 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.428059 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.428236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.428400 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.428552 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.428710 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-856941-3-iscsi {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.428859 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.429018 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.429170 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.429336 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.429488 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.429638 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.429801 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.429801 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.430098 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.430250 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.430404 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.430547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.430698 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.430847 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.433835 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.434009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.434174 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.434323 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.434479 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.434626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.434777 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.434994 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.435161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.435332 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.435476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.435626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.435771 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.435918 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.436060 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.436538 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.436688 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.436838 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.436988 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.437137 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.437305 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.437466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.437619 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.437760 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.437902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.438096 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.438260 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.438417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.438567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.438715 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.440026 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.440201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.440357 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.440508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.440669 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.440815 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.440958 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.440958 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.441237 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.441409 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.441562 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.441705 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.441854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.442006 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.442148 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.442148 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.442441 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.442651 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.442799 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.442997 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.443145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.443312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.443535 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.443690 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.443833 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.443982 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.444132 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.444281 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.444423 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.444588 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.444731 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.444887 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.445029 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.445170 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.445319 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.445461 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.445610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.445758 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.445908 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.446061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.446204 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.446390 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.446555 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.446698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.446847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.447111 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.447279 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.447430 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.447582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.447725 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.447873 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.448021 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.448206 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.448363 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.448525 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.448678 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.448826 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.448975 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.449416 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.449577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.449721 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.449987 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.450294 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.450458 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.450458 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.450754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.450925 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.451085 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.451085 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.451428 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.451571 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.451723 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.451873 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.452024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.452181 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.452330 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.452481 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.452720 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.452880 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.453022 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.453184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.453333 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.453475 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.453720 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.453871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.454013 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.454171 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.454315 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.454500 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.454647 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.454812 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.455057 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.455711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.455866 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.456008 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.456155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.456305 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.456460 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.456602 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.456743 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.456891 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.457033 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.457033 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.457338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.457481 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.457632 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.457784 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.457926 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.458074 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.458376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.458538 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.458696 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.458840 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.459048 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.459488 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.459642 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.459783 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.460022 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.460022 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.460547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.460708 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.460860 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.461012 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.461163 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.461305 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.461446 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.461599 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.461749 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.461901 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.462059 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.462203 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.462367 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.462511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.462651 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.462921 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.463091 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.463237 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.463378 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.463520 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.463765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.463915 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.464067 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.464209 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.464361 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.464511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.464660 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.464817 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.464967 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.465109 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.465258 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.465412 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.465561 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.465713 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.465862 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.466005 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.466146 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.466303 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.466453 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.466604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.466745 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.466928 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.467086 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.467247 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.467389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.467611 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.467762 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.467903 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.468052 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.468202 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.468202 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 01:17:54.468553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.468553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.468840 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.468992 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.469143 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.469286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.469750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.469903 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.470144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.470297 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.471256 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.471532 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.471777 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.472030 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.472238 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.472439 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.472650 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.472976 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.473206 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.473422 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.473614 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.473865 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.474018 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.474159 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.474322 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.474472 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.474624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.474774 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.474950 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.475118 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.475271 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.475421 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.475566 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.475706 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.475857 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.476013 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.476165 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.476325 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.476478 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.476621 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.476770 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.476927 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.477078 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.477227 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.477372 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.477521 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.477663 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.477813 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.477963 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.478104 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.478263 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.478456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.478614 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.478766 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.478959 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.479121 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.479272 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.479423 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.479922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.480068 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.480315 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.480465 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.480747 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.480897 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.481055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.481198 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.481460 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.481611 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.481762 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.481911 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.482064 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.482215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.482365 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.482514 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.482657 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.482822 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.483094 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.483253 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.483405 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.483555 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.483705 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.483949 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.484111 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.484255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.484255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.484532 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.484532 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.484818 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.484818 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.485108 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.485257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.485407 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.485556 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.485712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.485862 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.486005 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.486763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.486959 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.487109 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.487267 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.487422 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.487575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.487717 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.487867 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.488018 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.488163 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.488303 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.488446 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.488645 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.488790 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.488968 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.489116 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.489259 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.489417 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.489417 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.489999 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.490159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.490399 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.490399 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.490699 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.490989 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.491134 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.491289 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.491531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.491697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.491842 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.491994 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.492150 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.492301 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.492445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.492593 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.492743 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.492893 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.493050 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.493286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.493444 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.493595 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.493738 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.493886 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.494139 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.494296 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.494441 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.494591 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.494740 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.494976 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.495141 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.495292 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.495435 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.495584 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.495726 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.495881 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.496032 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.496191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.496334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.496474 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.496616 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.496777 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.496928 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.497077 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.497228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.497380 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.497523 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.497748 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.497900 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.498060 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.498258 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.498414 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.498608 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.498771 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.498946 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.499101 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.499252 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.499401 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.499562 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.500003 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.500156 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.500298 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.500534 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.500682 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.500841 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.501094 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.501237 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.501386 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.501528 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.501769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.501929 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.502080 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.502230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.502379 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.502521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.502673 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.502830 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.503042 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.503195 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.503420 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.503577 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.503733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.503879 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.504020 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.504332 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.504477 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.504618 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.504769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.504924 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.504924 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.505193 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.505349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.505492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.505644 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.505794 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.505936 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.506085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.506228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.506370 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.506525 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.506675 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.506828 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.507007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.507007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.507309 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.507462 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.507613 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.507764 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.507914 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.508063 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.508219 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.508362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.508504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.508708 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.508864 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.509014 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.509167 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.509317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.509467 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.509614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.509761 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.510280 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.510446 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.510678 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.510876 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.511051 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.511300 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.511454 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.511620 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.511790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.512031 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.512194 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.512344 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.512508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.512658 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.512814 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.512970 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.513118 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.513294 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.513719 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.513924 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.514088 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.514256 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.514478 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.514632 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.514795 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.514970 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.515131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.515318 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.515473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.515621 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.515781 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.516034 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.516178 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.516339 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.516496 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.516653 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.516811 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.516967 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.517123 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.517286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.517437 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.517600 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.517749 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.517905 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.518071 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.518228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.518376 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.518579 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.518777 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.518993 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.519144 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.519292 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.519438 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.519599 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.519748 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.519897 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.520346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.520527 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.520705 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.520924 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.521078 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.521226 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.521474 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.521639 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.521804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.521954 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.522211 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.522375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.522524 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.522693 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.522886 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.523045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.523193 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.523353 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.523510 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.523658 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.523904 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.524059 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.524206 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.524362 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.524605 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.524776 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.524938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.525086 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.525240 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.525397 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.525546 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.525702 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.525859 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.526008 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.526163 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.526318 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.526473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.526631 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.526778 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.526993 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.527159 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.527320 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.527469 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.527625 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.527773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.527927 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.528086 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.528243 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.528398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.528562 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.528718 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.528916 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.529081 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.529230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.529230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.529596 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.529752 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.529918 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.530082 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.530503 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.530670 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.530827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.531076 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.531234 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.531396 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.531658 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.531815 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.531963 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.532117 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.532376 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.532541 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.532691 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.532846 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.533478 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.533664 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.533823 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.534066 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.534240 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.534392 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.534550 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.534790 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.534988 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.535141 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.535301 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.535458 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.535458 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.535748 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.535748 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.535748 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.535748 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.536335 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.536493 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.536652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.536801 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.536957 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.537112 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.537268 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.537428 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.537586 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.537735 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.537890 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.538047 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.538047 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.538337 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.538494 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.538651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.538806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.539025 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.539180 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.539343 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.539500 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.539500 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.539790 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.539938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.540096 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.540267 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.540687 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.540842 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.540992 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.541222 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.541376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.541546 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.541805 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.541971 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.542130 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.542278 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.542528 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.542694 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.542883 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.543051 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.543212 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.543361 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.543509 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.543656 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.543656 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.543937 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.544177 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.544332 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.544488 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.544637 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.544819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.545051 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.545222 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.545374 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.545529 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.545686 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.545836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.545998 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.546148 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.546303 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.546458 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.546458 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.546750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.546943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.547127 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.547332 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.547493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.547641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.547789 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.547952 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.548109 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.548258 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.548406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.548560 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.549351 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.549517 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.549683 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.549840 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.550000 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.550149 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.550310 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.550725 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.550920 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.551078 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.551256 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.551473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.551637 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.551816 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.552056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.552222 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.552378 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.552554 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.552802 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.552958 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.552958 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.553249 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.553397 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.553544 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.553699 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.553849 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.554004 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.554173 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.554407 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.554609 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.554760 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.554927 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.554927 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.555320 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.555320 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.555614 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.555614 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.555894 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.556042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.556187 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.556187 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.556498 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.556647 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.556795 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.556949 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.557104 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.557260 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.557437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.557589 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.557736 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.557883 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.558030 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.558190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.558357 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.558506 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.558662 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.558827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.559074 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.559241 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.559440 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.559607 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.559765 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.559913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.560068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.560230 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.560230 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.560551 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.560956 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.561122 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.561542 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.561771 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.561924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.562099 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.562340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.562503 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.562503 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.562996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.562996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.563402 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.563571 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.563730 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.563888 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.564044 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.564200 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.564399 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.564627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.564786 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.564943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.565101 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.565451 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.565608 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.565759 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.565921 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.566084 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.566241 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.566398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.566547 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.567327 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.567489 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.567640 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.567788 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.567947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.568096 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.568262 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.568419 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.568589 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.568589 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.568891 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.569093 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.569256 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.569497 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.569667 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.572712 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.572882 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.573052 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.573242 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.573516 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.573688 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.573930 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.574093 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.574252 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.574409 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.574559 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.574784 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.575023 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.575178 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.575507 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.575666 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.575826 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.575975 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.576133 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.576133 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.576428 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.576585 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.576741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.576903 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.577053 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.577200 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.577368 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.577520 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.577668 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.577840 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.577997 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.578148 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.578297 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.578444 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.578600 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.578758 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.578939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.579095 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.579244 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.579391 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.579830 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.580038 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.580203 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.580353 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.580503 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.580651 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.580814 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.581135 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.581296 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.581446 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.581604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.581773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.581951 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.582091 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.582652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.582804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.582958 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.583113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.583269 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.583418 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.583586 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.583728 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.583881 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.584020 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.584169 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.584309 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.584449 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.584608 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.584750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.584895 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.585044 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.585191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.585337 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.585518 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.585744 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.585899 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.586042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.586189 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.586330 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.586476 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.586626 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.586781 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.586985 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.587125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.587273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.587471 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.587708 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.587936 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.588151 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.588366 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.588587 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.588812 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.589038 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.589306 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.589546 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.589546 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.589902 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.590065 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.590229 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.590391 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.590536 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.590700 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.590845 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.591071 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.591286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.591440 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.591589 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.591748 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.591906 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.592057 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.592215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.592374 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.592888 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.593046 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.593198 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.593358 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.593530 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.593682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.593899 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.594053 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.594199 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.594371 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.594520 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.594520 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.594810 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.595051 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.595199 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.595357 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.596068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.596296 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.596451 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.596451 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.596704 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.596704 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.597043 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.597232 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.597429 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.597719 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.597873 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.598032 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.598032 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.598366 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.598507 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.598708 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.598823 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.599022 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.599146 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.599146 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.599146 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.599510 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.599630 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.599794 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.599912 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.600032 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.600157 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.600276 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.600387 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.600387 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.600603 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.600714 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.600842 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.600953 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.601062 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.601170 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.601279 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.601388 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.601562 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.601680 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.601789 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.601898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.602008 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.602124 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.602124 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.602346 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.602457 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.602566 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.602681 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.602827 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.603162 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.603296 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.603386 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.603470 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.603569 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.603662 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.603754 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.603839 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.603970 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.604098 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.604220 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.604323 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.604446 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.604583 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.604681 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.604774 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.604909 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.605015 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.605103 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.605195 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.605280 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.605363 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.605454 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.605540 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.605624 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.605707 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.605791 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.605881 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.605974 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.606059 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.606148 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.606148 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.606398 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.606486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.606583 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.606669 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.606752 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.606844 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.606956 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.607094 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.607216 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.607336 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.607454 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.607572 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.607690 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.607816 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.607933 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.608042 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.608159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.608277 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.608440 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.608545 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.608632 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.608716 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.608841 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.608961 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.609096 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.609195 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.609289 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.609374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.609457 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.609540 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.609622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.609718 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.609862 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.609956 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.610050 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.610142 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.610235 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.610320 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.610413 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.610499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.610584 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.610667 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.610759 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.611015 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.611015 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.611726 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.611726 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.611942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.612041 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.612133 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.612225 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.612310 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.612393 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.612476 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.612567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.612658 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.612743 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.612825 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.612909 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.613020 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.613300 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.613393 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.613465 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.613465 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.613729 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.613833 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.613929 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.614061 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.614160 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.614247 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.614382 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.614487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.614573 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.614657 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.614740 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.614823 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.614944 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.615033 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.615116 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.615208 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.615301 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.615463 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.615567 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.615654 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.615744 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.615852 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.615945 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.616038 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.616131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.616223 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.616314 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.616401 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.616473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.616558 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.616642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.616740 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.616825 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.616915 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.616999 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.617092 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.617183 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.617274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.617366 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.617452 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.617544 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.617638 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.617730 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.617829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.617921 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.618006 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.618097 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.618181 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.618271 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.618363 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.618448 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.618531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.618824 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.618967 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.619054 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.619146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.619237 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.619322 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.619419 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.619512 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.619512 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.619680 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.619765 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.619765 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.620014 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.620111 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.620196 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.620286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.620286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.620452 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.620537 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.620537 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.620703 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.620703 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.620703 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.620946 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.620946 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.621110 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.621192 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.621275 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.621364 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.621364 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.621526 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.621623 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.621715 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.621799 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.621799 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.621965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.622055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.622146 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.622230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.622312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.622312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.622485 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.622576 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.622576 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.622737 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.622820 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.622954 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.623043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.623133 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.623233 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.623518 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.623615 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.623615 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.623835 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.623928 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.624021 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.624105 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.624198 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.624282 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.624379 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.624463 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.624594 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.624694 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.624789 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.624789 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.624951 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.625041 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.625180 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.625282 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.625282 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.625436 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.625525 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.625615 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.625615 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.625789 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.625879 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.625879 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.626045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.626130 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.626130 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.626295 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.626379 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.626379 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.626588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.626688 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.626688 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.627631 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.627754 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.627878 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.627988 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.628107 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.628220 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.628337 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.628449 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.628566 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.628678 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.628801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.628919 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.628919 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.629131 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.629248 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.629248 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.629475 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.629726 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.629726 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.629951 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.630076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.630076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.630564 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.630651 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.630760 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.630870 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.630870 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.631133 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.631264 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.631264 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.631264 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.631516 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.631599 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.631688 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.631779 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.631876 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.631961 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.632052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.632136 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.632219 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.632302 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.632394 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.632485 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.632485 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.632644 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.632728 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.632818 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.632915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.633008 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.633098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.633182 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.633272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.633272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.633272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.633272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.633771 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.633771 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.633941 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.633941 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.634113 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.634197 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.634287 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.634370 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.634460 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.634553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.634639 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.634721 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.634803 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.634953 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.635054 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.635149 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.635149 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.635149 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.635394 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.635486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.635577 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.635674 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.635758 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.635840 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.635929 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.636012 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.636112 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.636204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.636204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.636373 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.636457 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.636539 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.636629 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.636713 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.636795 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.636881 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.637016 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.637117 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.637278 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.637278 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.637443 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.637532 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.637616 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.637706 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.637706 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.637880 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.637952 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.638036 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.638120 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.638211 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.638295 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.638385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.638473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.638557 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.638646 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.638739 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.638824 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.638935 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.639030 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.639115 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.639197 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.639288 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.639380 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.639464 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.639553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.639645 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.639742 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.639834 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.639918 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.640000 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.640082 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.640165 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.640256 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.640340 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.640423 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.640506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.640588 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.640669 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.640765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.640849 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.640938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.641028 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.641111 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.641203 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.641292 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.641376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.641458 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.641541 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.641622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.641845 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.641942 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.642162 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.642263 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.643029 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.643131 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.643343 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.643446 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.643685 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.643853 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.643955 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.644239 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.644340 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.644547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.644651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.644865 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.644958 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.645173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.645273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.645476 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.645567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.645783 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.645911 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.646092 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.646236 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.646397 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.646700 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.646833 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.647026 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.647171 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.647327 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.647541 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.647685 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.647886 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.648018 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.648212 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.648345 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.648513 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.648655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.648813 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.648957 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.649115 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.649256 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.649417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.649550 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.649723 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.649869 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.650026 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.650161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.650329 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.650462 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.650629 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.650773 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.650946 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.651103 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.651267 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.651400 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.651596 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.651745 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.651928 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.652069 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.652240 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.652372 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.652555 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.652688 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.652863 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.653038 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.653184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.653323 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.653465 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.653596 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.653866 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.654007 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.654137 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.654265 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.654403 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.654597 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.654738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.654947 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.655081 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.655275 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.655409 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.655599 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.655732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.655923 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.656054 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.656231 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.656371 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.656542 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.656683 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.656853 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.656985 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.657167 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.657306 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.657488 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.657620 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.657789 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.657920 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.658678 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.658820 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.659039 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.659196 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.659362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.659511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.659680 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.659814 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.659986 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.660118 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.660307 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.660449 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.660617 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.660749 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.660926 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.661059 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.661236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.661370 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.661546 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.661687 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.661854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.661986 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.662168 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.662310 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.662478 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.662610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.662787 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.662950 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.663129 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.663272 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.663446 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.663580 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.663774 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.664128 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.664267 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.664398 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.664537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.664666 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.664794 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.664932 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.665068 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.665198 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.665350 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.665492 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.665662 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.665838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.666010 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.666150 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.666337 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.666470 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.666652 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.666800 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.666992 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.667122 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.667276 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.667421 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.667567 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120415) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 01:17:54.667698 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.667900 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.668209 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.668518 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.668827 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.669135 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.669441 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.669749 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.670062 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.670370 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.670685 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.671016 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.671325 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.671631 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.671969 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.672307 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.672630 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.672959 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.673274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.673621 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.674023 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.674371 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.674707 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.675070 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.675390 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.675730 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.676047 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.676683 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.676999 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.677315 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.677631 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.677963 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.678292 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.678602 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.678961 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.679286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.679611 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.679932 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.680248 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.680587 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.680902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.681216 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.681530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.681845 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.682159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.682479 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.682792 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.683134 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.683583 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.683773 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.684211 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.684550 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.684866 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.685198 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.685532 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.685882 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.686199 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.686811 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.687168 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.687487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.687804 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.688113 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 01:17:54.688362 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120412) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 01:17:54.728401 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO dbcounter [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] Registered counter for database nova_api Sep 13 01:17:54.749101 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:17:54.750234 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO dbcounter [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] Registered counter for database nova_api Sep 13 01:17:54.755577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writer thread running {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:17:54.770472 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_db.sqlalchemy.engines [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:17:54.777303 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writer thread running {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:17:54.810936 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.context [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cf926edd-6fab-4cd6-938e-882d6f32df12(cell1) {{(pid=120415) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 01:17:54.815258 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:17:54.815730 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:17:54.817270 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:17:54.818008 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:17:54.818456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:17:54.820467 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:17:54.822437 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO dbcounter [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] Registered counter for database nova_cell0 Sep 13 01:17:54.826447 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO dbcounter [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] Registered counter for database nova_cell1 Sep 13 01:17:54.835298 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.context [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),cf926edd-6fab-4cd6-938e-882d6f32df12(cell1) {{(pid=120412) load_cells /opt/stack/nova/nova/context.py:464}} Sep 13 01:17:54.835505 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:17:54.836807 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:17:54.837641 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:17:54.838105 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:17:54.839733 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:17:54.840484 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:17:54.840657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writer thread running {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:17:54.840936 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:17:54.842994 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:17:54.844998 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO dbcounter [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] Registered counter for database nova_cell0 Sep 13 01:17:54.847307 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writer thread running {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:17:54.849643 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO dbcounter [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] Registered counter for database nova_cell1 Sep 13 01:17:54.856919 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_db.sqlalchemy.engines [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:17:54.859205 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_db.sqlalchemy.engines [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:17:54.864350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writer thread running {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:17:54.869599 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writer thread running {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:17:54.992681 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO dbcounter [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] Registered counter for database nova_cell0 Sep 13 01:17:54.999264 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_db.sqlalchemy.engines [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120415) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:17:55.004211 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writer thread running {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:17:55.012826 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO dbcounter [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] Registered counter for database nova_cell0 Sep 13 01:17:55.020322 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_db.sqlalchemy.engines [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120412) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 01:17:55.025096 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writer thread running {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 01:17:55.321907 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: WARNING keystonemiddleware.auth_token [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 01:17:55.329068 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: WARNING keystonemiddleware.auth_token [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 01:17:55.358928 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: WARNING keystonemiddleware.auth_token [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 01:17:55.366715 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: WARNING keystonemiddleware.auth_token [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 01:17:55.675070 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: WARNING keystonemiddleware.auth_token [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 01:17:55.680949 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: WARNING keystonemiddleware.auth_token [None req-4b0e4b53-08e8-4cfe-8577-cd98c01ddd94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 01:17:55.686484 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558c7ab1a9c0 pid: 120415 (default app) Sep 13 01:17:55.722718 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: WARNING keystonemiddleware.auth_token [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 13 01:17:55.728938 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: WARNING keystonemiddleware.auth_token [None req-842bef07-4f9b-452e-b7fa-fcbeea51404e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 13 01:17:55.734623 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x558c7ab1a9c0 pid: 120412 (default app) Sep 13 01:18:31.857762 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:31.862426 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:31.864317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:31.866140 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:34.432290 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-69519f49-fd96-4413-9a0a-3894f1d25201 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] Action: 'create', calling method: .version_select at 0x7fb05f40a4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-451837705", "metadata": {"Type": "work"}}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:18:34.970810 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=3 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:34.971697 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=3 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:34.972645 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=3 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:34.975193 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=3 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:35.728436 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-114a744a-450d-47ea-b4df-338e5cf17fc8 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] Calling method '.version_select at 0x7fb05f4bbf70>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:36.241737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-69519f49-fd96-4413-9a0a-3894f1d25201 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.398864 Sep 13 01:18:36.243671 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Sep 13 01:18:31 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4403 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 01:18:36.293432 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-661cbaa1-410d-4179-8d1b-cb1962ccdb06 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] Calling method '.version_select at 0x7fb05f2d63a0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:36.515268 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-661cbaa1-410d-4179-8d1b-cb1962ccdb06 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/27e23e23-98f3-47b2-9fe1-cc4c2ecc145f" status: 200 len: 352 microversion: 2.1 time: 0.258073 Sep 13 01:18:36.516414 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 2/2] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:18:36 2022] GET /compute/v2.1/os-volumes/27e23e23-98f3-47b2-9fe1-cc4c2ecc145f => generated 352 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:18:36.797825 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-114a744a-450d-47ea-b4df-338e5cf17fc8 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/93fb8548-4f14-45ec-ac3a-b92690b3616a" status: 200 len: 350 microversion: 2.1 time: 1.833525 Sep 13 01:18:36.812518 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 1/3] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:18:34 2022] GET /compute/v2.1/os-volumes/93fb8548-4f14-45ec-ac3a-b92690b3616a => generated 350 bytes in 1851 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:18:37.530967 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-efef46e3-2940-4dd7-9b53-7e9cc3af06a0 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] Calling method '.version_select at 0x7fb05f2d6a60>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:37.650783 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-efef46e3-2940-4dd7-9b53-7e9cc3af06a0 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/27e23e23-98f3-47b2-9fe1-cc4c2ecc145f" status: 200 len: 353 microversion: 2.1 time: 0.124018 Sep 13 01:18:37.652783 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 3/4] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:18:37 2022] GET /compute/v2.1/os-volumes/27e23e23-98f3-47b2-9fe1-cc4c2ecc145f => generated 353 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:18:37.668645 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f13d26b7-95db-45a0-9c8b-4aa54fc7b924 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] Calling method '.version_select at 0x7fb05f2cb310>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:37.784851 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f13d26b7-95db-45a0-9c8b-4aa54fc7b924 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/27e23e23-98f3-47b2-9fe1-cc4c2ecc145f" status: 200 len: 353 microversion: 2.1 time: 0.121683 Sep 13 01:18:37.786025 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 2/5] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:18:37 2022] GET /compute/v2.1/os-volumes/27e23e23-98f3-47b2-9fe1-cc4c2ecc145f => generated 353 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:18:37.809143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7b5664a7-c455-4a01-84dd-078c5ab08807 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] Calling method '.version_select at 0x7fb05f277160>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:37.966303 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7b5664a7-c455-4a01-84dd-078c5ab08807 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/27e23e23-98f3-47b2-9fe1-cc4c2ecc145f" status: 202 len: 0 microversion: 2.1 time: 0.161625 Sep 13 01:18:37.966895 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 4/6] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 01:18:37 2022] DELETE /compute/v2.1/os-volumes/27e23e23-98f3-47b2-9fe1-cc4c2ecc145f => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:18:37.976081 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-92de74f5-607d-4c94-a32b-619cdd9be71c tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] Calling method '.version_select at 0x7fb05f2cba60>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:38.077274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-92de74f5-607d-4c94-a32b-619cdd9be71c tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/27e23e23-98f3-47b2-9fe1-cc4c2ecc145f" status: 200 len: 352 microversion: 2.1 time: 0.104068 Sep 13 01:18:38.077844 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 3/7] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:18:37 2022] GET /compute/v2.1/os-volumes/27e23e23-98f3-47b2-9fe1-cc4c2ecc145f => generated 352 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:18:38.983752 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0637379f-fb8e-422e-be62-946664ea5c74 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] Calling method '.version_select at 0x7fb05f2d6d30>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:39.074742 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0637379f-fb8e-422e-be62-946664ea5c74 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e129ac1a-fee5-400a-9f8b-55c02b67b7ea" status: 200 len: 350 microversion: 2.1 time: 0.096722 Sep 13 01:18:39.084348 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 5/8] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:18:38 2022] GET /compute/v2.1/os-volumes/e129ac1a-fee5-400a-9f8b-55c02b67b7ea => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:18:39.093520 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-111a455b-ef24-4e95-8600-94dc636b1711 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] Calling method '.version_select at 0x7fb05f2d5160>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:39.149864 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-111a455b-ef24-4e95-8600-94dc636b1711 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] HTTP exception thrown: Volume 27e23e23-98f3-47b2-9fe1-cc4c2ecc145f could not be found. Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-111a455b-ef24-4e95-8600-94dc636b1711 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] Request method failure captured: Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/os-volumes/27e23e23-98f3-47b2-9fe1-cc4c2ecc145f HTTP/1.1 Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9pnpCGMfHo2kO-hnW_7Bg7xws43MUbDBcOpSgpUY8lqpc8DX4ucW5La-cQ0WFmx020ruuOvX9SDJEoLrLj0-u2nSrUYb3Y7wQtyINbh42pQBySLlwg7xIK0B0AOhTQDj9qZqplp6EGDhgQRFvlC7hXMZP_IFt_E7W7hqhneTM2qqZU Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 768dedda6202441c89b6d64055c98913 Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-VolumesGetTestJSON-1826260608 Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:18:39.155145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:18:39.156302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_768dedda6202441c89b6d64055c98913"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/768dedda6202441c89b6d64055c98913"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/768dedda6202441c89b6d64055c98913"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/768dedda6202441c89b6d64055c98913"}]}] Sep 13 01:18:39.156302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-VolumesGetTestJSON-1826260608 Sep 13 01:18:39.156302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 768dedda6202441c89b6d64055c98913 Sep 13 01:18:39.156302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-VolumesGetTestJSON-1826260608 Sep 13 01:18:39.156302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-VolumesGetTestJSON-1826260608-project Sep 13 01:18:39.156302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:18:39.156302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:18:39.156302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: d7ae54329f314168a85a05672d3a5fdc Sep 13 01:18:39.156302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-VolumesGetTestJSON-1826260608-project Sep 13 01:18:39.156302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: Sep 13 01:18:39.156302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Volume 27e23e23-98f3-47b2-9fe1-cc4c2ecc145f could not be found. Sep 13 01:18:39.156302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '27e23e23-98f3-47b2-9fe1-cc4c2ecc145f'} Sep 13 01:18:39.156302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 27e23e23-98f3-47b2-9fe1-cc4c2ecc145f could not be found. (HTTP 404) (Request-ID: req-fb31b9bc-c846-4620-a6cc-fb2e0ac467ac) Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:18:39.157575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 01:18:39.158431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 27e23e23-98f3-47b2-9fe1-cc4c2ecc145f could not be found. Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 01:18:39.159274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:18:39.160068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 27e23e23-98f3-47b2-9fe1-cc4c2ecc145f could not be found. Sep 13 01:18:39.160068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:18:39.160068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:18:39.160068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:18:39.160068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:18:39.160068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:18:39.160068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:18:39.160068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:18:39.160068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:18:39.160068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 27e23e23-98f3-47b2-9fe1-cc4c2ecc145f could not be found. Sep 13 01:18:39.160068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:18:39.161390 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-111a455b-ef24-4e95-8600-94dc636b1711 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] Returning 404 to user: Volume 27e23e23-98f3-47b2-9fe1-cc4c2ecc145f could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:18:39.162519 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-111a455b-ef24-4e95-8600-94dc636b1711 tempest-VolumesGetTestJSON-1826260608 tempest-VolumesGetTestJSON-1826260608-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/27e23e23-98f3-47b2-9fe1-cc4c2ecc145f" status: 404 len: 109 microversion: 2.1 time: 0.073801 Sep 13 01:18:39.163652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 4/9] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:18:39 2022] GET /compute/v2.1/os-volumes/27e23e23-98f3-47b2-9fe1-cc4c2ecc145f => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:18:39.895320 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-75428080-247c-4630-aa39-99c20aed78d7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Action: 'create', calling method: .version_select at 0x7fb05f2d6670>, body: {"keypair": {"name": "tempest-keypair-553207030", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOl5Nv0dJuOCISjNNMVyvKlhjW90SWlfu1e23ELjAEwhcAg9+dkmoZkjBTgvb4+SWBcRb0Lvmk2gc4M23r6MDvH7DZQJxt9bC5sUzqMnLJHmFg8p0E0dgZS5wZMpN/xvrQ=="}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:18:40.052459 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-75428080-247c-4630-aa39-99c20aed78d7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Getting quotas for project 9056ec686513412a87c292387e25e870. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:18:40.069308 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-75428080-247c-4630-aa39-99c20aed78d7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Getting quotas for user 349e19300f1e48c3ac44fc34611c7f4a and project 9056ec686513412a87c292387e25e870. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:18:40.151704 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-75428080-247c-4630-aa39-99c20aed78d7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.632415 Sep 13 01:18:40.153645 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 6/10] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 01:18:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:18:40.839489 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-bdea6c1a-5b91-4593-8ab3-01f2e29e3849 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] Calling method '.version_select at 0x7fb05f2d5af0>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:40.975584 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-bdea6c1a-5b91-4593-8ab3-01f2e29e3849 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/607c80ef-1b25-4dbe-854f-a9dd6393a97f" status: 200 len: 351 microversion: 2.1 time: 0.140463 Sep 13 01:18:40.987413 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 5/11] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:18:40 2022] GET /compute/v2.1/os-volumes/607c80ef-1b25-4dbe-854f-a9dd6393a97f => generated 351 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:18:40.993577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f8ec0e68-0963-4ae5-b65b-9b921c4b9412 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] Calling method '.version_select at 0x7fb05f2530d0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:41.195264 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f8ec0e68-0963-4ae5-b65b-9b921c4b9412 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.197502 Sep 13 01:18:41.195264 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 7/12] 10.222.0.15 () {58 vars in 1134 bytes} [Tue Sep 13 01:18:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:41.206077 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-2fa1ecf5-2851-4f62-89c7-2c4faca30059 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] Calling method '.version_select at 0x7fb05f2d5040>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:41.357271 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-2fa1ecf5-2851-4f62-89c7-2c4faca30059 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.156005 Sep 13 01:18:41.373566 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4ef6eaa0-ef16-4d5c-adb2-7147710b4914 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] Calling method '.version_select at 0x7fb05f2009d0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:41.374159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 6/13] 10.222.0.15 () {58 vars in 1149 bytes} [Tue Sep 13 01:18:41 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:18:41.631002 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4ef6eaa0-ef16-4d5c-adb2-7147710b4914 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.261279 Sep 13 01:18:41.646223 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7ee63616-c117-4798-85c0-0677951029f8 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] Calling method '.version_select at 0x7fb05f2d5820>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:41.649143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 8/14] 10.222.0.15 () {58 vars in 1134 bytes} [Tue Sep 13 01:18:41 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:41.847972 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7ee63616-c117-4798-85c0-0677951029f8 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.205596 Sep 13 01:18:41.848803 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 7/15] 10.222.0.15 () {58 vars in 1167 bytes} [Tue Sep 13 01:18:41 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:18:41.862545 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-429661e4-e424-4dbe-99d6-6d84172e4b62 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] Calling method '.version_select at 0x7fb05f200d30>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:42.054903 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-429661e4-e424-4dbe-99d6-6d84172e4b62 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.195965 Sep 13 01:18:42.055953 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 9/16] 10.222.0.15 () {58 vars in 1170 bytes} [Tue Sep 13 01:18:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:18:42.072163 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e0530dee-fb08-4b3d-ac4a-5daf38d7ed55 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] Calling method '.version_select at 0x7fb05f2cc700>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:42.235135 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-e0530dee-fb08-4b3d-ac4a-5daf38d7ed55 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.167971 Sep 13 01:18:42.235906 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 8/17] 10.222.0.15 () {58 vars in 1155 bytes} [Tue Sep 13 01:18:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:42.251988 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ce4a4cee-adc8-4d6d-ab0d-acef079792e4 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] Calling method '.version_select at 0x7fb05f253b80>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:42.470374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ce4a4cee-adc8-4d6d-ab0d-acef079792e4 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.223570 Sep 13 01:18:42.479680 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 10/18] 10.222.0.15 () {58 vars in 1188 bytes} [Tue Sep 13 01:18:42 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:18:42.486450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-73997385-2049-4bf2-9154-becfeabf7c57 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] Calling method '.version_select at 0x7fb05f2ccca0>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:42.698809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-73997385-2049-4bf2-9154-becfeabf7c57 tempest-VolumesTestJSON-1058627202 tempest-VolumesTestJSON-1058627202-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.216808 Sep 13 01:18:42.699947 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 9/19] 10.222.0.15 () {58 vars in 1155 bytes} [Tue Sep 13 01:18:42 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:48.680105 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-52258521", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdb1d525-4a86-4d73-99d0-0254f6253a0a"}], "security_groups": [{"name": "tempest-securitygroup--1661316253"}], "key_name": "tempest-keypair-553207030", "user_data": "}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:18:49.392638 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2049813841", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:18:49.469937 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] validate_networks() for [('bdb1d525-4a86-4d73-99d0-0254f6253a0a', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:18:49.667929 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.network.neutron [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] validate_networks() for [('f76e7426-2310-4c50-8ad0-bf7be7b0fe24', None, None, None, None, None)] {{(pid=120412) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:18:50.100003 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=4 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:18:51.806525 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Flavor limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:18:51.807942 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Image limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:18:51.808659 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Flavor pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:18:51.809288 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Image pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:18:51.809927 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:18:51.842784 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:51.848092 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:51.849039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:51.850083 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:51.850773 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:51.851576 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:51.903740 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:18:51.904170 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:18:51.904634 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:18:51.904989 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:18:51.905417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:18:51.918639 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Getting quotas for project a84dd36fe9484f41bc2f0d7da4e47c13. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:18:51.922380 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:51.922890 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:51.923333 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:51.924066 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:51.924520 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:51.924936 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:51.927940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Getting quotas for user 0c5dcfa5794843a5896fa051a4554e1f and project a84dd36fe9484f41bc2f0d7da4e47c13. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:18:51.943092 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Going to run 1 instances... {{(pid=120412) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:18:51.946465 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120412) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:18:51.992131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Getting quotas for project 9056ec686513412a87c292387e25e870. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:18:51.997051 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Getting quotas for user 349e19300f1e48c3ac44fc34611c7f4a and project 9056ec686513412a87c292387e25e870. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:18:52.021053 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:18:52.024267 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:18:52.103717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c5ffabc4-279e-410b-807b-2a75a0851378 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.070322 Sep 13 01:18:52.108574 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 10/20] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:18:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 3076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 01:18:52.191422 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-42208ad3-352f-4043-9e24-f68f182d7a05 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.518461 Sep 13 01:18:52.192280 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 11/21] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:18:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 3521 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 01:18:52.206679 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-afc3bdbb-2769-4462-9795-1589f9f1676f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:52.208164 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-afc3bdbb-2769-4462-9795-1589f9f1676f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:52.482702 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-afc3bdbb-2769-4462-9795-1589f9f1676f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:52.510500 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-afc3bdbb-2769-4462-9795-1589f9f1676f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1222 microversion: 2.1 time: 0.316756 Sep 13 01:18:52.527028 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 12/22] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:18:52 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1222 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:52.532254 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8950f9c7-ebe8-4f12-8419-c6b6e7125902 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:52.532726 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8950f9c7-ebe8-4f12-8419-c6b6e7125902 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:52.704445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8950f9c7-ebe8-4f12-8419-c6b6e7125902 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:52.713651 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8950f9c7-ebe8-4f12-8419-c6b6e7125902 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1235 microversion: 2.1 time: 0.185304 Sep 13 01:18:52.727290 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 13/23] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:18:52 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1235 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:52.819432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-46115c4e-3901-43bc-b950-bc54fe787c2f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Action: 'create', calling method: .version_select at 0x7fb05f2d5d30>, body: {"keypair": {"name": "tempest-keypair-607275102", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6KsKtgVji2ZWnD8A7ibbH+EJJrR+TqUTEOvjG3POAzP9KAnO+zXEev5MtJuXy4umO4xvT5Ozc9lrs1sCOd4Sxnib3SPBll4P1/5qb7RyoV4o0lLE7pcohraxODIN5mNg=="}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:18:52.901982 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-46115c4e-3901-43bc-b950-bc54fe787c2f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Getting quotas for project 7a9e1eee32f04f3cabd8219d36d2c6a7. Resources: {'key_pairs'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:18:52.909840 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-46115c4e-3901-43bc-b950-bc54fe787c2f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Getting quotas for user e2846ad486314958bb74af71b647c470 and project 7a9e1eee32f04f3cabd8219d36d2c6a7. Resources: {'key_pairs'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:18:52.974112 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-46115c4e-3901-43bc-b950-bc54fe787c2f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.861703 Sep 13 01:18:52.976170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 11/24] 10.222.0.15 () {62 vars in 1200 bytes} [Tue Sep 13 01:18:52 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 865 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 01:18:53.198369 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1966780891", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:18:53.346953 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] validate_networks() for [('f76e7426-2310-4c50-8ad0-bf7be7b0fe24', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:18:54.649212 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:18:54.649860 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:18:54.650189 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:18:54.650671 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:18:54.651176 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:18:54.660793 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:54.662726 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:54.663631 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:54.664769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:54.666910 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:54.672230 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:54.751006 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Getting quotas for project a84dd36fe9484f41bc2f0d7da4e47c13. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:18:54.773383 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Getting quotas for user 0c5dcfa5794843a5896fa051a4554e1f and project a84dd36fe9484f41bc2f0d7da4e47c13. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:18:54.824951 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:18:54.834171 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:18:54.949363 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2a28149a-0784-408f-8049-b3410bbf7ae9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.753067 Sep 13 01:18:54.951963 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 14/25] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:18:53 2022] POST /compute/v2.1/servers => generated 383 bytes in 1758 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 01:18:54.965852 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5b190b24-4b21-4840-84b7-1f653a9a919c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:54.967399 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5b190b24-4b21-4840-84b7-1f653a9a919c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:55.087306 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5b190b24-4b21-4840-84b7-1f653a9a919c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:55.099997 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5b190b24-4b21-4840-84b7-1f653a9a919c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1235 microversion: 2.1 time: 0.144750 Sep 13 01:18:55.102316 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 15/26] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:18:54 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1235 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:55.116237 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fc8bd83c-7f00-4970-8ed8-f3b02e9eb72c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:55.118842 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fc8bd83c-7f00-4970-8ed8-f3b02e9eb72c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:55.216539 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-971827013", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "networks": [{"uuid": "ee5e6d32-76f2-40e4-8379-2f8cd4f72b00"}]}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:18:55.364095 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.network.neutron [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] validate_networks() for [('ee5e6d32-76f2-40e4-8379-2f8cd4f72b00', None, None, None, None, None)] {{(pid=120412) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:18:55.388282 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fc8bd83c-7f00-4970-8ed8-f3b02e9eb72c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:55.405269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fc8bd83c-7f00-4970-8ed8-f3b02e9eb72c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1222 microversion: 2.1 time: 0.293615 Sep 13 01:18:55.406654 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 16/27] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:18:55 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1222 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:56.128823 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c4060df0-9e43-4510-8dbe-279125e63b67 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:56.129448 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c4060df0-9e43-4510-8dbe-279125e63b67 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:56.137331 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4060df0-9e43-4510-8dbe-279125e63b67 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:56.137836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4060df0-9e43-4510-8dbe-279125e63b67 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:56.138286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4060df0-9e43-4510-8dbe-279125e63b67 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:56.151152 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4060df0-9e43-4510-8dbe-279125e63b67 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:56.151794 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4060df0-9e43-4510-8dbe-279125e63b67 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:56.152418 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4060df0-9e43-4510-8dbe-279125e63b67 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:56.542437 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c4060df0-9e43-4510-8dbe-279125e63b67 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:56.560928 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c4060df0-9e43-4510-8dbe-279125e63b67 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1239 microversion: 2.1 time: 0.435507 Sep 13 01:18:56.569926 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 17/28] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:18:56 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1239 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:56.578643 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-764da511-8991-4ff3-a169-8f173fc7203b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:56.579636 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-764da511-8991-4ff3-a169-8f173fc7203b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:56.587841 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-764da511-8991-4ff3-a169-8f173fc7203b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:56.589187 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-764da511-8991-4ff3-a169-8f173fc7203b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:56.590656 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-764da511-8991-4ff3-a169-8f173fc7203b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:56.591894 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-764da511-8991-4ff3-a169-8f173fc7203b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:56.592563 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-764da511-8991-4ff3-a169-8f173fc7203b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:56.593961 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-764da511-8991-4ff3-a169-8f173fc7203b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:56.717125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-764da511-8991-4ff3-a169-8f173fc7203b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:56.727200 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-764da511-8991-4ff3-a169-8f173fc7203b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1226 microversion: 2.1 time: 0.154875 Sep 13 01:18:56.727947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 18/29] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:18:56 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1226 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:57.068937 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Flavor limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:18:57.069645 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Image limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:18:57.070282 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Flavor pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:18:57.070830 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Image pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:18:57.071293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:18:57.089265 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:57.089748 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:57.090185 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:57.090971 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:57.091427 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:57.091849 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:57.135152 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Getting quotas for project 6475b1b1e54c4b0eb86021d82021de78. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:18:57.140043 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Getting quotas for user 06797d4f56954444b3317f2339f020c4 and project 6475b1b1e54c4b0eb86021d82021de78. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:18:57.154206 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Going to run 1 instances... {{(pid=120412) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:18:57.157121 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120412) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:18:57.233104 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-36612a13-01e5-43c0-a7dd-cbfdd137b7f2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.551153 Sep 13 01:18:57.238025 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 12/30] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:18:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 3558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 01:18:57.255384 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-43911b9d-0dcf-4ea5-95ff-0a5322937cfe tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:57.255836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-43911b9d-0dcf-4ea5-95ff-0a5322937cfe tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:57.328609 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-43911b9d-0dcf-4ea5-95ff-0a5322937cfe tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:57.336352 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-43911b9d-0dcf-4ea5-95ff-0a5322937cfe tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1214 microversion: 2.1 time: 0.088293 Sep 13 01:18:57.350747 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 19/31] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:18:57 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:57.541224 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1152670438", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47cc024b-679e-42c4-bf2a-2407e9c9e294"}], "security_groups": [{"name": "tempest-securitygroup--397638621"}], "key_name": "tempest-keypair-607275102", "user_data": "}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:18:57.595315 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-dca0e262-26a4-4db3-a545-084d112f3893 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:57.596103 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-dca0e262-26a4-4db3-a545-084d112f3893 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:57.606275 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dca0e262-26a4-4db3-a545-084d112f3893 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:57.609137 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dca0e262-26a4-4db3-a545-084d112f3893 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:57.610791 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dca0e262-26a4-4db3-a545-084d112f3893 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:57.615309 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dca0e262-26a4-4db3-a545-084d112f3893 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:57.621289 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dca0e262-26a4-4db3-a545-084d112f3893 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:57.621975 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dca0e262-26a4-4db3-a545-084d112f3893 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:57.725349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.network.neutron [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] validate_networks() for [('47cc024b-679e-42c4-bf2a-2407e9c9e294', None, None, None, None, None)] {{(pid=120412) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:18:57.817998 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-dca0e262-26a4-4db3-a545-084d112f3893 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:57.828229 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-dca0e262-26a4-4db3-a545-084d112f3893 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1239 microversion: 2.1 time: 0.236714 Sep 13 01:18:57.842060 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 20/32] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:18:57 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1239 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:18:57.863956 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-72a6d05a-49b9-44db-81d9-6d0e5c63ab38 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:57.868510 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-72a6d05a-49b9-44db-81d9-6d0e5c63ab38 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:57.884935 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-72a6d05a-49b9-44db-81d9-6d0e5c63ab38 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:57.885613 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-72a6d05a-49b9-44db-81d9-6d0e5c63ab38 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:57.887854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-72a6d05a-49b9-44db-81d9-6d0e5c63ab38 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:57.888754 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-72a6d05a-49b9-44db-81d9-6d0e5c63ab38 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:57.889216 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-72a6d05a-49b9-44db-81d9-6d0e5c63ab38 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:57.889646 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-72a6d05a-49b9-44db-81d9-6d0e5c63ab38 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:58.011447 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-72a6d05a-49b9-44db-81d9-6d0e5c63ab38 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:58.020723 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-72a6d05a-49b9-44db-81d9-6d0e5c63ab38 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1226 microversion: 2.1 time: 0.175198 Sep 13 01:18:58.021308 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 21/33] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:18:57 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1226 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:58.362285 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e9deaaa0-18db-440c-93a4-060e7f58342a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:58.362933 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e9deaaa0-18db-440c-93a4-060e7f58342a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:58.363617 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Flavor limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:18:58.364049 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Image limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:18:58.364517 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Flavor pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:18:58.365266 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Image pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:18:58.365665 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:18:58.371537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9deaaa0-18db-440c-93a4-060e7f58342a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:58.372034 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9deaaa0-18db-440c-93a4-060e7f58342a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:58.372464 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9deaaa0-18db-440c-93a4-060e7f58342a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:58.378541 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9deaaa0-18db-440c-93a4-060e7f58342a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:58.380309 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9deaaa0-18db-440c-93a4-060e7f58342a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:58.382004 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9deaaa0-18db-440c-93a4-060e7f58342a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:58.382123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:58.382595 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:58.383187 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:58.383952 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:58.384415 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:58.384842 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:58.441111 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Getting quotas for project 7a9e1eee32f04f3cabd8219d36d2c6a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:18:58.451231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Getting quotas for user e2846ad486314958bb74af71b647c470 and project 7a9e1eee32f04f3cabd8219d36d2c6a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:18:58.485349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Going to run 1 instances... {{(pid=120412) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:18:58.488228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120412) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:18:58.509427 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e9deaaa0-18db-440c-93a4-060e7f58342a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:58.523994 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e9deaaa0-18db-440c-93a4-060e7f58342a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1218 microversion: 2.1 time: 0.167062 Sep 13 01:18:58.525856 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 22/34] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:18:58 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1218 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:58.604134 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-8391d371-9f34-47b8-a1ab-34a18ab1ceb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.067574 Sep 13 01:18:58.605144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 13/35] 10.222.0.15 () {62 vars in 1188 bytes} [Tue Sep 13 01:18:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 1072 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 01:18:58.619552 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-efaa887c-efb6-4dd2-82dd-84cf69c13e45 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:58.620327 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-efaa887c-efb6-4dd2-82dd-84cf69c13e45 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:58.731714 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-efaa887c-efb6-4dd2-82dd-84cf69c13e45 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:58.741143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-efaa887c-efb6-4dd2-82dd-84cf69c13e45 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:58.742605 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-efaa887c-efb6-4dd2-82dd-84cf69c13e45 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:58.743805 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-efaa887c-efb6-4dd2-82dd-84cf69c13e45 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1281 microversion: 2.20 time: 0.129332 Sep 13 01:18:58.744463 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 23/36] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:18:58 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1281 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:18:58.859603 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-677f7b65-5bc3-4f60-9883-b0ff92b0ecf3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:58.860907 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-677f7b65-5bc3-4f60-9883-b0ff92b0ecf3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:58.892539 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-677f7b65-5bc3-4f60-9883-b0ff92b0ecf3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:58.893056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-677f7b65-5bc3-4f60-9883-b0ff92b0ecf3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:58.896206 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-677f7b65-5bc3-4f60-9883-b0ff92b0ecf3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:58.899147 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-677f7b65-5bc3-4f60-9883-b0ff92b0ecf3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:58.900987 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-677f7b65-5bc3-4f60-9883-b0ff92b0ecf3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:58.902060 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-677f7b65-5bc3-4f60-9883-b0ff92b0ecf3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:59.048473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a65721c4-7f25-4de6-82b2-7b48ea0cd329 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:59.049087 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a65721c4-7f25-4de6-82b2-7b48ea0cd329 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:59.066214 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a65721c4-7f25-4de6-82b2-7b48ea0cd329 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:59.066890 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a65721c4-7f25-4de6-82b2-7b48ea0cd329 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:59.067651 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a65721c4-7f25-4de6-82b2-7b48ea0cd329 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:59.068049 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a65721c4-7f25-4de6-82b2-7b48ea0cd329 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:59.068507 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a65721c4-7f25-4de6-82b2-7b48ea0cd329 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:59.068978 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a65721c4-7f25-4de6-82b2-7b48ea0cd329 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:59.189114 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a65721c4-7f25-4de6-82b2-7b48ea0cd329 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:59.205539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a65721c4-7f25-4de6-82b2-7b48ea0cd329 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1218 microversion: 2.1 time: 0.162404 Sep 13 01:18:59.206747 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 24/37] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:18:59 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1218 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:59.237685 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-677f7b65-5bc3-4f60-9883-b0ff92b0ecf3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:59.283331 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-677f7b65-5bc3-4f60-9883-b0ff92b0ecf3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1231 microversion: 2.1 time: 0.421976 Sep 13 01:18:59.285061 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 14/38] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:18:58 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1231 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:18:59.556503 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1c576330-bbe8-4030-8b17-af463b9b5d14 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:59.558558 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1c576330-bbe8-4030-8b17-af463b9b5d14 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:59.570683 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c576330-bbe8-4030-8b17-af463b9b5d14 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:59.571656 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c576330-bbe8-4030-8b17-af463b9b5d14 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:59.572322 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c576330-bbe8-4030-8b17-af463b9b5d14 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:59.575649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c576330-bbe8-4030-8b17-af463b9b5d14 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:59.576974 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c576330-bbe8-4030-8b17-af463b9b5d14 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:59.578489 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c576330-bbe8-4030-8b17-af463b9b5d14 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:59.771168 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e191112e-e2d2-45b6-b073-c9a7c3238753 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:18:59.771896 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-e191112e-e2d2-45b6-b073-c9a7c3238753 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:18:59.780233 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e191112e-e2d2-45b6-b073-c9a7c3238753 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:59.782597 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e191112e-e2d2-45b6-b073-c9a7c3238753 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:59.806582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e191112e-e2d2-45b6-b073-c9a7c3238753 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:59.808056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e191112e-e2d2-45b6-b073-c9a7c3238753 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:18:59.811365 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e191112e-e2d2-45b6-b073-c9a7c3238753 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:18:59.815781 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e191112e-e2d2-45b6-b073-c9a7c3238753 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:18:59.979418 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1c576330-bbe8-4030-8b17-af463b9b5d14 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:18:59.993942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1c576330-bbe8-4030-8b17-af463b9b5d14 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1266 microversion: 2.1 time: 0.447245 Sep 13 01:19:00.010290 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 25/39] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:18:59 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1266 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:00.229262 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a8a7cc8a-03f4-43fd-95de-2eab1a74f479 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:00.230159 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a8a7cc8a-03f4-43fd-95de-2eab1a74f479 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:00.248311 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a8a7cc8a-03f4-43fd-95de-2eab1a74f479 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:00.251189 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a8a7cc8a-03f4-43fd-95de-2eab1a74f479 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:00.254509 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a8a7cc8a-03f4-43fd-95de-2eab1a74f479 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:00.260860 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a8a7cc8a-03f4-43fd-95de-2eab1a74f479 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:00.263051 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a8a7cc8a-03f4-43fd-95de-2eab1a74f479 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:00.265158 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a8a7cc8a-03f4-43fd-95de-2eab1a74f479 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:00.311312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-e191112e-e2d2-45b6-b073-c9a7c3238753 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:00.331822 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-e191112e-e2d2-45b6-b073-c9a7c3238753 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:00.338033 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-e191112e-e2d2-45b6-b073-c9a7c3238753 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:00.350927 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-e191112e-e2d2-45b6-b073-c9a7c3238753 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1277 microversion: 2.20 time: 0.583688 Sep 13 01:19:00.376427 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 15/40] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:18:59 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1277 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:00.381379 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9bbfaa95-139e-420d-827a-36b55aecd0cd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:00.382003 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9bbfaa95-139e-420d-827a-36b55aecd0cd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:00.433183 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9bbfaa95-139e-420d-827a-36b55aecd0cd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:00.433864 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9bbfaa95-139e-420d-827a-36b55aecd0cd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:00.437207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9bbfaa95-139e-420d-827a-36b55aecd0cd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:00.439043 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9bbfaa95-139e-420d-827a-36b55aecd0cd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:00.439660 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9bbfaa95-139e-420d-827a-36b55aecd0cd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:00.463845 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9bbfaa95-139e-420d-827a-36b55aecd0cd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:00.819078 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-9bbfaa95-139e-420d-827a-36b55aecd0cd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:00.836170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9bbfaa95-139e-420d-827a-36b55aecd0cd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1231 microversion: 2.1 time: 0.458359 Sep 13 01:19:00.838259 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 16/41] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:00 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1231 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:00.873605 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a8a7cc8a-03f4-43fd-95de-2eab1a74f479 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:00.894271 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a8a7cc8a-03f4-43fd-95de-2eab1a74f479 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1274 microversion: 2.1 time: 0.665650 Sep 13 01:19:00.895122 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 26/42] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:00 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1274 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:01.019021 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a99ed2b2-fa9e-405a-868f-f4c26617fcc2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:01.020200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a99ed2b2-fa9e-405a-868f-f4c26617fcc2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:01.033974 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a99ed2b2-fa9e-405a-868f-f4c26617fcc2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:01.038242 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a99ed2b2-fa9e-405a-868f-f4c26617fcc2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:01.038689 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a99ed2b2-fa9e-405a-868f-f4c26617fcc2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:01.039479 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a99ed2b2-fa9e-405a-868f-f4c26617fcc2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:01.050651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a99ed2b2-fa9e-405a-868f-f4c26617fcc2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:01.054411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a99ed2b2-fa9e-405a-868f-f4c26617fcc2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:01.384349 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d03b0f9b-0dad-4bc9-ae04-60ba4c4255bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:01.385019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d03b0f9b-0dad-4bc9-ae04-60ba4c4255bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:01.395943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d03b0f9b-0dad-4bc9-ae04-60ba4c4255bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:01.396459 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d03b0f9b-0dad-4bc9-ae04-60ba4c4255bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:01.396907 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d03b0f9b-0dad-4bc9-ae04-60ba4c4255bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:01.397616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d03b0f9b-0dad-4bc9-ae04-60ba4c4255bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:01.398070 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d03b0f9b-0dad-4bc9-ae04-60ba4c4255bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:01.398677 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d03b0f9b-0dad-4bc9-ae04-60ba4c4255bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:01.563698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d03b0f9b-0dad-4bc9-ae04-60ba4c4255bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:01.574608 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d03b0f9b-0dad-4bc9-ae04-60ba4c4255bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:01.576851 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d03b0f9b-0dad-4bc9-ae04-60ba4c4255bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:01.579228 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d03b0f9b-0dad-4bc9-ae04-60ba4c4255bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1277 microversion: 2.20 time: 0.199281 Sep 13 01:19:01.591954 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 27/43] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:01 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1277 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:01.771152 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a99ed2b2-fa9e-405a-868f-f4c26617fcc2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:01.787461 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a99ed2b2-fa9e-405a-868f-f4c26617fcc2 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1272 microversion: 2.1 time: 0.772151 Sep 13 01:19:01.788610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 17/44] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:01 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1272 bytes in 774 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:01.865300 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-083ba53c-8ac9-4f44-b08b-bdeeb85f2812 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:01.866279 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-083ba53c-8ac9-4f44-b08b-bdeeb85f2812 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:01.880790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-083ba53c-8ac9-4f44-b08b-bdeeb85f2812 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:01.881986 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-083ba53c-8ac9-4f44-b08b-bdeeb85f2812 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:01.882581 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-083ba53c-8ac9-4f44-b08b-bdeeb85f2812 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:01.883477 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-083ba53c-8ac9-4f44-b08b-bdeeb85f2812 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:01.884079 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-083ba53c-8ac9-4f44-b08b-bdeeb85f2812 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:01.884651 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-083ba53c-8ac9-4f44-b08b-bdeeb85f2812 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:01.922972 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-93cae87d-736f-412a-98b5-f5e61556a24f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:01.924607 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-93cae87d-736f-412a-98b5-f5e61556a24f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:01.937100 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-93cae87d-736f-412a-98b5-f5e61556a24f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:01.946094 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-93cae87d-736f-412a-98b5-f5e61556a24f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:01.946737 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-93cae87d-736f-412a-98b5-f5e61556a24f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:01.947759 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-93cae87d-736f-412a-98b5-f5e61556a24f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:01.952968 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-93cae87d-736f-412a-98b5-f5e61556a24f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:01.954581 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-93cae87d-736f-412a-98b5-f5e61556a24f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:02.096835 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-083ba53c-8ac9-4f44-b08b-bdeeb85f2812 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:02.104832 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-083ba53c-8ac9-4f44-b08b-bdeeb85f2812 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1287 microversion: 2.1 time: 0.243643 Sep 13 01:19:02.113401 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 28/45] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:01 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1287 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:02.301114 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-93cae87d-736f-412a-98b5-f5e61556a24f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:02.315702 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-93cae87d-736f-412a-98b5-f5e61556a24f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1280 microversion: 2.1 time: 0.397802 Sep 13 01:19:02.322840 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 18/46] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:01 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1280 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:02.608015 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e9184c1b-8497-4200-bee3-3052df174bd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:02.608655 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e9184c1b-8497-4200-bee3-3052df174bd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:02.616591 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=7 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:02.618030 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9184c1b-8497-4200-bee3-3052df174bd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:02.620261 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9184c1b-8497-4200-bee3-3052df174bd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:02.620707 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9184c1b-8497-4200-bee3-3052df174bd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:02.622688 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9184c1b-8497-4200-bee3-3052df174bd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:02.631309 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9184c1b-8497-4200-bee3-3052df174bd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:02.631767 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9184c1b-8497-4200-bee3-3052df174bd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:02.732527 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e9184c1b-8497-4200-bee3-3052df174bd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:02.742990 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e9184c1b-8497-4200-bee3-3052df174bd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:02.744256 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e9184c1b-8497-4200-bee3-3052df174bd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:02.748982 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e9184c1b-8497-4200-bee3-3052df174bd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1333 microversion: 2.20 time: 0.145161 Sep 13 01:19:02.764193 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 29/47] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:02 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1333 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:02.815505 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d7d82d0a-80a1-4558-bcf2-77f21354c27c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:02.816963 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d7d82d0a-80a1-4558-bcf2-77f21354c27c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:02.828951 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d7d82d0a-80a1-4558-bcf2-77f21354c27c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:02.833376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d7d82d0a-80a1-4558-bcf2-77f21354c27c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:02.834184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d7d82d0a-80a1-4558-bcf2-77f21354c27c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:02.835893 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d7d82d0a-80a1-4558-bcf2-77f21354c27c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:02.836665 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d7d82d0a-80a1-4558-bcf2-77f21354c27c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:02.837766 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d7d82d0a-80a1-4558-bcf2-77f21354c27c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:03.144016 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-37930b19-2611-4689-b9b6-c3c3a64c65b0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:03.144717 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-37930b19-2611-4689-b9b6-c3c3a64c65b0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:03.154291 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37930b19-2611-4689-b9b6-c3c3a64c65b0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:03.163776 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37930b19-2611-4689-b9b6-c3c3a64c65b0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:03.164655 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37930b19-2611-4689-b9b6-c3c3a64c65b0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:03.166116 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37930b19-2611-4689-b9b6-c3c3a64c65b0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:03.178131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37930b19-2611-4689-b9b6-c3c3a64c65b0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:03.179135 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37930b19-2611-4689-b9b6-c3c3a64c65b0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:03.244083 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d7d82d0a-80a1-4558-bcf2-77f21354c27c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:03.253066 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d7d82d0a-80a1-4558-bcf2-77f21354c27c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.442064 Sep 13 01:19:03.254613 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 19/48] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:02 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:03.271212 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-37930b19-2611-4689-b9b6-c3c3a64c65b0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:03.280751 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-37930b19-2611-4689-b9b6-c3c3a64c65b0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1295 microversion: 2.1 time: 0.142088 Sep 13 01:19:03.281930 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 30/49] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:03 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1295 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:03.352397 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d2580c94-4143-4edc-85d7-819778aabce1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:03.353363 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d2580c94-4143-4edc-85d7-819778aabce1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:03.366382 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d2580c94-4143-4edc-85d7-819778aabce1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:03.367206 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d2580c94-4143-4edc-85d7-819778aabce1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:03.367889 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d2580c94-4143-4edc-85d7-819778aabce1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:03.369086 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d2580c94-4143-4edc-85d7-819778aabce1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:03.370036 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d2580c94-4143-4edc-85d7-819778aabce1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:03.370845 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d2580c94-4143-4edc-85d7-819778aabce1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:03.570187 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d2580c94-4143-4edc-85d7-819778aabce1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:03.579005 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d2580c94-4143-4edc-85d7-819778aabce1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.236867 Sep 13 01:19:03.584532 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 20/50] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:03 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:03.777526 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7f1d0324-b8de-48ff-92c1-647393afbf7c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:03.778339 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7f1d0324-b8de-48ff-92c1-647393afbf7c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:03.784453 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7f1d0324-b8de-48ff-92c1-647393afbf7c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:03.784992 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7f1d0324-b8de-48ff-92c1-647393afbf7c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:03.785634 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7f1d0324-b8de-48ff-92c1-647393afbf7c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:03.786398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7f1d0324-b8de-48ff-92c1-647393afbf7c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:03.786937 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7f1d0324-b8de-48ff-92c1-647393afbf7c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:03.787534 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7f1d0324-b8de-48ff-92c1-647393afbf7c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:03.852651 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7f1d0324-b8de-48ff-92c1-647393afbf7c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:03.863576 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7f1d0324-b8de-48ff-92c1-647393afbf7c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:03.865319 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7f1d0324-b8de-48ff-92c1-647393afbf7c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:03.866489 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7f1d0324-b8de-48ff-92c1-647393afbf7c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1333 microversion: 2.20 time: 0.092924 Sep 13 01:19:03.867349 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 31/51] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:03 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1333 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:04.278068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-101b7f94-5672-4069-9a1a-2b8b1dec0034 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:04.279371 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-101b7f94-5672-4069-9a1a-2b8b1dec0034 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:04.286747 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-101b7f94-5672-4069-9a1a-2b8b1dec0034 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:04.287361 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-101b7f94-5672-4069-9a1a-2b8b1dec0034 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:04.287990 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-101b7f94-5672-4069-9a1a-2b8b1dec0034 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:04.288746 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-101b7f94-5672-4069-9a1a-2b8b1dec0034 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:04.292593 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-101b7f94-5672-4069-9a1a-2b8b1dec0034 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:04.292593 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-101b7f94-5672-4069-9a1a-2b8b1dec0034 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:04.306117 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-17822737-dde3-4763-9fc4-557d5e4dce4d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:04.307678 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-17822737-dde3-4763-9fc4-557d5e4dce4d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:04.317942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-17822737-dde3-4763-9fc4-557d5e4dce4d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:04.318493 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-17822737-dde3-4763-9fc4-557d5e4dce4d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:04.319042 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-17822737-dde3-4763-9fc4-557d5e4dce4d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:04.320096 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-17822737-dde3-4763-9fc4-557d5e4dce4d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:04.320714 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-17822737-dde3-4763-9fc4-557d5e4dce4d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:04.321153 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-17822737-dde3-4763-9fc4-557d5e4dce4d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:04.397444 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-17822737-dde3-4763-9fc4-557d5e4dce4d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:04.409780 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-17822737-dde3-4763-9fc4-557d5e4dce4d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1295 microversion: 2.1 time: 0.108190 Sep 13 01:19:04.422879 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 32/52] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:04 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1295 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:04.471995 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-101b7f94-5672-4069-9a1a-2b8b1dec0034 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:04.483402 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-101b7f94-5672-4069-9a1a-2b8b1dec0034 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.209630 Sep 13 01:19:04.484693 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 21/53] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:04 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:04.607842 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7e788732-303d-426a-bf20-6a912b4b1a2a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:04.609015 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7e788732-303d-426a-bf20-6a912b4b1a2a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:04.615267 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e788732-303d-426a-bf20-6a912b4b1a2a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:04.615758 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e788732-303d-426a-bf20-6a912b4b1a2a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:04.616198 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e788732-303d-426a-bf20-6a912b4b1a2a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:04.616902 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e788732-303d-426a-bf20-6a912b4b1a2a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:04.617387 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e788732-303d-426a-bf20-6a912b4b1a2a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:04.617844 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e788732-303d-426a-bf20-6a912b4b1a2a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:04.700921 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=4 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:04.881830 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7e788732-303d-426a-bf20-6a912b4b1a2a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:04.896485 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-efe4cf82-18b8-41d9-9736-56a2e88fa44a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:04.897092 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-efe4cf82-18b8-41d9-9736-56a2e88fa44a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:04.907754 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7e788732-303d-426a-bf20-6a912b4b1a2a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.304088 Sep 13 01:19:04.909596 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-efe4cf82-18b8-41d9-9736-56a2e88fa44a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:04.931062 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 33/54] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:04 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:04.931827 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-efe4cf82-18b8-41d9-9736-56a2e88fa44a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:04.932456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-efe4cf82-18b8-41d9-9736-56a2e88fa44a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:04.933380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-efe4cf82-18b8-41d9-9736-56a2e88fa44a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:04.934000 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-efe4cf82-18b8-41d9-9736-56a2e88fa44a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:04.934444 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-efe4cf82-18b8-41d9-9736-56a2e88fa44a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:05.001349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-efe4cf82-18b8-41d9-9736-56a2e88fa44a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:05.011384 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-efe4cf82-18b8-41d9-9736-56a2e88fa44a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:05.012870 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-efe4cf82-18b8-41d9-9736-56a2e88fa44a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:05.013996 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-efe4cf82-18b8-41d9-9736-56a2e88fa44a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1333 microversion: 2.20 time: 0.121860 Sep 13 01:19:05.014952 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 22/55] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:04 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1333 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:05.435942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-91981e86-62dc-4bea-bf3a-5d60c60c920e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:05.437648 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-91981e86-62dc-4bea-bf3a-5d60c60c920e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:05.448898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91981e86-62dc-4bea-bf3a-5d60c60c920e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:05.449558 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91981e86-62dc-4bea-bf3a-5d60c60c920e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:05.456366 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91981e86-62dc-4bea-bf3a-5d60c60c920e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:05.462965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91981e86-62dc-4bea-bf3a-5d60c60c920e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:05.463528 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91981e86-62dc-4bea-bf3a-5d60c60c920e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:05.463993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91981e86-62dc-4bea-bf3a-5d60c60c920e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:05.509811 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-94b9a2b5-0fba-4f61-8ba6-14a37bd4a998 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:05.513191 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-94b9a2b5-0fba-4f61-8ba6-14a37bd4a998 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:05.539372 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-94b9a2b5-0fba-4f61-8ba6-14a37bd4a998 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:05.541555 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-94b9a2b5-0fba-4f61-8ba6-14a37bd4a998 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:05.545621 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-94b9a2b5-0fba-4f61-8ba6-14a37bd4a998 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:05.549021 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-94b9a2b5-0fba-4f61-8ba6-14a37bd4a998 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:05.551112 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-94b9a2b5-0fba-4f61-8ba6-14a37bd4a998 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:05.551830 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-94b9a2b5-0fba-4f61-8ba6-14a37bd4a998 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:05.569461 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-91981e86-62dc-4bea-bf3a-5d60c60c920e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:05.574170 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:05.584391 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-91981e86-62dc-4bea-bf3a-5d60c60c920e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1295 microversion: 2.1 time: 0.152166 Sep 13 01:19:05.586019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 34/56] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:05 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1295 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:05.831799 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-94b9a2b5-0fba-4f61-8ba6-14a37bd4a998 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:05.843536 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-94b9a2b5-0fba-4f61-8ba6-14a37bd4a998 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.339659 Sep 13 01:19:05.844760 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 23/57] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:05 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:05.938745 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7c79eb63-b8d9-4f6d-a8e4-eb84ee3684ad tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:05.939421 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7c79eb63-b8d9-4f6d-a8e4-eb84ee3684ad tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:05.955538 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c79eb63-b8d9-4f6d-a8e4-eb84ee3684ad tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:05.956190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c79eb63-b8d9-4f6d-a8e4-eb84ee3684ad tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:05.956655 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c79eb63-b8d9-4f6d-a8e4-eb84ee3684ad tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:05.957416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c79eb63-b8d9-4f6d-a8e4-eb84ee3684ad tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:05.957861 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c79eb63-b8d9-4f6d-a8e4-eb84ee3684ad tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:05.960065 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7c79eb63-b8d9-4f6d-a8e4-eb84ee3684ad tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:06.045451 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f83f6953-9d0d-4f7e-9981-d1b436034970 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:06.053061 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-f83f6953-9d0d-4f7e-9981-d1b436034970 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:06.064686 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f83f6953-9d0d-4f7e-9981-d1b436034970 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:06.068876 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f83f6953-9d0d-4f7e-9981-d1b436034970 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:06.069384 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f83f6953-9d0d-4f7e-9981-d1b436034970 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:06.070041 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f83f6953-9d0d-4f7e-9981-d1b436034970 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:06.073374 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f83f6953-9d0d-4f7e-9981-d1b436034970 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:06.077853 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f83f6953-9d0d-4f7e-9981-d1b436034970 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:06.159550 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f83f6953-9d0d-4f7e-9981-d1b436034970 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:06.171858 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f83f6953-9d0d-4f7e-9981-d1b436034970 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:06.173698 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f83f6953-9d0d-4f7e-9981-d1b436034970 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:06.175195 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f83f6953-9d0d-4f7e-9981-d1b436034970 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1333 microversion: 2.20 time: 0.139687 Sep 13 01:19:06.176259 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 24/58] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:06 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1333 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:06.263003 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7c79eb63-b8d9-4f6d-a8e4-eb84ee3684ad tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:06.272419 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7c79eb63-b8d9-4f6d-a8e4-eb84ee3684ad tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.338459 Sep 13 01:19:06.278118 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 35/59] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:05 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:06.617273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-bf726cb7-7741-4119-b515-382b870b8bf7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:06.618230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-bf726cb7-7741-4119-b515-382b870b8bf7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:06.624615 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bf726cb7-7741-4119-b515-382b870b8bf7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:06.625107 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bf726cb7-7741-4119-b515-382b870b8bf7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:06.625547 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bf726cb7-7741-4119-b515-382b870b8bf7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:06.626249 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bf726cb7-7741-4119-b515-382b870b8bf7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:06.626710 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bf726cb7-7741-4119-b515-382b870b8bf7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:06.627165 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bf726cb7-7741-4119-b515-382b870b8bf7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:06.699814 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-bf726cb7-7741-4119-b515-382b870b8bf7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:06.712795 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-bf726cb7-7741-4119-b515-382b870b8bf7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1295 microversion: 2.1 time: 0.104348 Sep 13 01:19:06.715101 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 25/60] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:06 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1295 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:06.868747 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b4db3685-e23c-405e-8487-8dbf5a62c1e9 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:06.869471 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b4db3685-e23c-405e-8487-8dbf5a62c1e9 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:06.876805 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4db3685-e23c-405e-8487-8dbf5a62c1e9 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:06.877658 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4db3685-e23c-405e-8487-8dbf5a62c1e9 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:06.878324 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4db3685-e23c-405e-8487-8dbf5a62c1e9 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:06.879300 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4db3685-e23c-405e-8487-8dbf5a62c1e9 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:06.879991 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4db3685-e23c-405e-8487-8dbf5a62c1e9 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:06.881325 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b4db3685-e23c-405e-8487-8dbf5a62c1e9 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:07.060738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b4db3685-e23c-405e-8487-8dbf5a62c1e9 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:07.069762 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b4db3685-e23c-405e-8487-8dbf5a62c1e9 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.204324 Sep 13 01:19:07.071202 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 36/61] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:06 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:07.209709 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-2ba7c8ba-77d7-40d7-9b9a-6164366d6799 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:07.210997 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-2ba7c8ba-77d7-40d7-9b9a-6164366d6799 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:07.218960 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2ba7c8ba-77d7-40d7-9b9a-6164366d6799 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:07.219875 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2ba7c8ba-77d7-40d7-9b9a-6164366d6799 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:07.220603 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2ba7c8ba-77d7-40d7-9b9a-6164366d6799 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:07.221655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2ba7c8ba-77d7-40d7-9b9a-6164366d6799 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:07.222529 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2ba7c8ba-77d7-40d7-9b9a-6164366d6799 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:07.223317 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2ba7c8ba-77d7-40d7-9b9a-6164366d6799 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:07.294350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2ba7c8ba-77d7-40d7-9b9a-6164366d6799 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:07.300339 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-909631f2-82a5-45dd-8348-ce950488e6cb tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:07.301320 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-909631f2-82a5-45dd-8348-ce950488e6cb tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:07.303193 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2ba7c8ba-77d7-40d7-9b9a-6164366d6799 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:07.304652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2ba7c8ba-77d7-40d7-9b9a-6164366d6799 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:07.305763 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-2ba7c8ba-77d7-40d7-9b9a-6164366d6799 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1333 microversion: 2.20 time: 0.105826 Sep 13 01:19:07.308117 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-909631f2-82a5-45dd-8348-ce950488e6cb tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:07.309743 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-909631f2-82a5-45dd-8348-ce950488e6cb tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:07.310388 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-909631f2-82a5-45dd-8348-ce950488e6cb tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:07.312079 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-909631f2-82a5-45dd-8348-ce950488e6cb tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:07.312738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-909631f2-82a5-45dd-8348-ce950488e6cb tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:07.313315 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-909631f2-82a5-45dd-8348-ce950488e6cb tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:07.319125 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 26/62] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:07 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1333 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:07.524483 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-909631f2-82a5-45dd-8348-ce950488e6cb tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:07.532531 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-909631f2-82a5-45dd-8348-ce950488e6cb tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.236606 Sep 13 01:19:07.533408 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 37/63] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:07 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:07.737764 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-63241d6f-6f92-4cb5-889f-da55ccbb20e6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:07.738379 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-63241d6f-6f92-4cb5-889f-da55ccbb20e6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:07.744290 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-63241d6f-6f92-4cb5-889f-da55ccbb20e6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:07.744772 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-63241d6f-6f92-4cb5-889f-da55ccbb20e6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:07.745218 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-63241d6f-6f92-4cb5-889f-da55ccbb20e6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:07.745911 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-63241d6f-6f92-4cb5-889f-da55ccbb20e6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:07.746366 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-63241d6f-6f92-4cb5-889f-da55ccbb20e6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:07.746789 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-63241d6f-6f92-4cb5-889f-da55ccbb20e6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:07.826604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-63241d6f-6f92-4cb5-889f-da55ccbb20e6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:07.835800 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-63241d6f-6f92-4cb5-889f-da55ccbb20e6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1295 microversion: 2.1 time: 0.101916 Sep 13 01:19:07.836944 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 27/64] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:07 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1295 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:08.098079 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-35b1e82b-19db-4e61-8e3e-2be989c2a150 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:08.099202 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-35b1e82b-19db-4e61-8e3e-2be989c2a150 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:08.109084 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-35b1e82b-19db-4e61-8e3e-2be989c2a150 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:08.109565 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-35b1e82b-19db-4e61-8e3e-2be989c2a150 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:08.110224 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-35b1e82b-19db-4e61-8e3e-2be989c2a150 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:08.111057 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-35b1e82b-19db-4e61-8e3e-2be989c2a150 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:08.111428 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-35b1e82b-19db-4e61-8e3e-2be989c2a150 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:08.111973 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-35b1e82b-19db-4e61-8e3e-2be989c2a150 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:08.290192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-35b1e82b-19db-4e61-8e3e-2be989c2a150 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:08.298527 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-35b1e82b-19db-4e61-8e3e-2be989c2a150 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.204336 Sep 13 01:19:08.299736 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 38/65] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:08 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:08.332321 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-694879aa-5e2f-4ff5-8a1e-4bdb1f7290fd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:08.332938 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-694879aa-5e2f-4ff5-8a1e-4bdb1f7290fd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:08.339500 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-694879aa-5e2f-4ff5-8a1e-4bdb1f7290fd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:08.340297 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-694879aa-5e2f-4ff5-8a1e-4bdb1f7290fd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:08.340811 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-694879aa-5e2f-4ff5-8a1e-4bdb1f7290fd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:08.341937 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-694879aa-5e2f-4ff5-8a1e-4bdb1f7290fd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:08.342760 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-694879aa-5e2f-4ff5-8a1e-4bdb1f7290fd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:08.343445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-694879aa-5e2f-4ff5-8a1e-4bdb1f7290fd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:08.421250 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=6 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:08.468735 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-694879aa-5e2f-4ff5-8a1e-4bdb1f7290fd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:08.478085 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=22 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:08.483031 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-694879aa-5e2f-4ff5-8a1e-4bdb1f7290fd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:08.484516 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-694879aa-5e2f-4ff5-8a1e-4bdb1f7290fd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:08.485953 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-694879aa-5e2f-4ff5-8a1e-4bdb1f7290fd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1333 microversion: 2.20 time: 0.157564 Sep 13 01:19:08.486540 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 28/66] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:08 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1333 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:08.555515 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-35320fc6-316c-4dc8-be92-deb6159c7715 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:08.556866 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-35320fc6-316c-4dc8-be92-deb6159c7715 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:08.567149 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-35320fc6-316c-4dc8-be92-deb6159c7715 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:08.568112 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-35320fc6-316c-4dc8-be92-deb6159c7715 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:08.569263 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-35320fc6-316c-4dc8-be92-deb6159c7715 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:08.570813 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-35320fc6-316c-4dc8-be92-deb6159c7715 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:08.571521 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-35320fc6-316c-4dc8-be92-deb6159c7715 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:08.572072 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-35320fc6-316c-4dc8-be92-deb6159c7715 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:08.739437 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=24 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:08.788101 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-35320fc6-316c-4dc8-be92-deb6159c7715 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:08.797108 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-35320fc6-316c-4dc8-be92-deb6159c7715 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.245419 Sep 13 01:19:08.799916 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 39/67] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:08 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:08.863157 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-667906d3-06cc-492e-bbc2-8f842d9c02e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:08.863903 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-667906d3-06cc-492e-bbc2-8f842d9c02e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:08.878811 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-667906d3-06cc-492e-bbc2-8f842d9c02e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:08.879343 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-667906d3-06cc-492e-bbc2-8f842d9c02e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:08.879789 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-667906d3-06cc-492e-bbc2-8f842d9c02e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:08.880505 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-667906d3-06cc-492e-bbc2-8f842d9c02e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:08.880962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-667906d3-06cc-492e-bbc2-8f842d9c02e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:08.881391 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-667906d3-06cc-492e-bbc2-8f842d9c02e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:08.934431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=100 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:09.006085 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-667906d3-06cc-492e-bbc2-8f842d9c02e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:09.019194 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-667906d3-06cc-492e-bbc2-8f842d9c02e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1295 microversion: 2.1 time: 0.162155 Sep 13 01:19:09.021355 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 29/68] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:08 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1295 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:09.331733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1ade3299-066e-4a4c-997f-508bfa7f7f6b tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:09.332771 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1ade3299-066e-4a4c-997f-508bfa7f7f6b tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:09.342072 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1ade3299-066e-4a4c-997f-508bfa7f7f6b tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:09.342780 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1ade3299-066e-4a4c-997f-508bfa7f7f6b tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:09.343256 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1ade3299-066e-4a4c-997f-508bfa7f7f6b tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:09.344133 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1ade3299-066e-4a4c-997f-508bfa7f7f6b tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:09.345270 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1ade3299-066e-4a4c-997f-508bfa7f7f6b tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:09.346230 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1ade3299-066e-4a4c-997f-508bfa7f7f6b tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:09.515909 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-715cefda-b743-4782-9b8c-bb7b966a1532 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:09.516984 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-715cefda-b743-4782-9b8c-bb7b966a1532 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:09.528646 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-715cefda-b743-4782-9b8c-bb7b966a1532 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:09.529144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-715cefda-b743-4782-9b8c-bb7b966a1532 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:09.529584 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-715cefda-b743-4782-9b8c-bb7b966a1532 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:09.530330 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-715cefda-b743-4782-9b8c-bb7b966a1532 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:09.534311 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-715cefda-b743-4782-9b8c-bb7b966a1532 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:09.534831 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-715cefda-b743-4782-9b8c-bb7b966a1532 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:09.611796 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-715cefda-b743-4782-9b8c-bb7b966a1532 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:09.613819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1ade3299-066e-4a4c-997f-508bfa7f7f6b tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:09.622931 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-715cefda-b743-4782-9b8c-bb7b966a1532 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:09.628217 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-715cefda-b743-4782-9b8c-bb7b966a1532 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:09.630719 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-715cefda-b743-4782-9b8c-bb7b966a1532 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1333 microversion: 2.20 time: 0.121575 Sep 13 01:19:09.642614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1ade3299-066e-4a4c-997f-508bfa7f7f6b tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.322038 Sep 13 01:19:09.643736 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 40/69] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:09 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:09.659704 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 30/70] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:09 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1333 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:19:09.829349 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e63a51d8-167c-42e7-8556-52ef2cf343a3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:09.830666 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e63a51d8-167c-42e7-8556-52ef2cf343a3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:09.840221 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e63a51d8-167c-42e7-8556-52ef2cf343a3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:09.840764 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e63a51d8-167c-42e7-8556-52ef2cf343a3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:09.841205 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e63a51d8-167c-42e7-8556-52ef2cf343a3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:09.841945 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e63a51d8-167c-42e7-8556-52ef2cf343a3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:09.842735 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e63a51d8-167c-42e7-8556-52ef2cf343a3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:09.843346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e63a51d8-167c-42e7-8556-52ef2cf343a3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:10.060948 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e63a51d8-167c-42e7-8556-52ef2cf343a3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:10.065129 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7fea6f52-8c5a-4c3d-91f5-b17708ecc556 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:10.068622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7fea6f52-8c5a-4c3d-91f5-b17708ecc556 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:10.078284 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7fea6f52-8c5a-4c3d-91f5-b17708ecc556 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:10.078960 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7fea6f52-8c5a-4c3d-91f5-b17708ecc556 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:10.079660 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7fea6f52-8c5a-4c3d-91f5-b17708ecc556 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:10.080644 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7fea6f52-8c5a-4c3d-91f5-b17708ecc556 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:10.081630 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7fea6f52-8c5a-4c3d-91f5-b17708ecc556 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:10.081940 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e63a51d8-167c-42e7-8556-52ef2cf343a3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.254710 Sep 13 01:19:10.082589 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7fea6f52-8c5a-4c3d-91f5-b17708ecc556 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:10.082792 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 41/71] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:09 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:10.206806 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7fea6f52-8c5a-4c3d-91f5-b17708ecc556 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:10.216103 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7fea6f52-8c5a-4c3d-91f5-b17708ecc556 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1295 microversion: 2.1 time: 0.159353 Sep 13 01:19:10.217040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 31/72] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:10 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1295 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:10.671242 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1c2d1b01-9eba-4124-adb0-a1bcbd2fa601 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:10.671936 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1c2d1b01-9eba-4124-adb0-a1bcbd2fa601 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:10.677826 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-88411f17-22f3-4041-b2be-a4c3a227f622 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:10.679073 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-88411f17-22f3-4041-b2be-a4c3a227f622 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:10.682605 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c2d1b01-9eba-4124-adb0-a1bcbd2fa601 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:10.682736 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c2d1b01-9eba-4124-adb0-a1bcbd2fa601 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:10.683174 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c2d1b01-9eba-4124-adb0-a1bcbd2fa601 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:10.683871 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c2d1b01-9eba-4124-adb0-a1bcbd2fa601 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:10.684325 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c2d1b01-9eba-4124-adb0-a1bcbd2fa601 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:10.687230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:10.689216 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-88411f17-22f3-4041-b2be-a4c3a227f622 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:10.689542 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c2d1b01-9eba-4124-adb0-a1bcbd2fa601 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:10.690489 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-88411f17-22f3-4041-b2be-a4c3a227f622 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:10.691268 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-88411f17-22f3-4041-b2be-a4c3a227f622 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:10.692214 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-88411f17-22f3-4041-b2be-a4c3a227f622 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:10.692878 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-88411f17-22f3-4041-b2be-a4c3a227f622 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:10.693703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-88411f17-22f3-4041-b2be-a4c3a227f622 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:10.792515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-88411f17-22f3-4041-b2be-a4c3a227f622 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:10.808269 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-88411f17-22f3-4041-b2be-a4c3a227f622 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:10.812798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-88411f17-22f3-4041-b2be-a4c3a227f622 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:10.815512 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-88411f17-22f3-4041-b2be-a4c3a227f622 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1333 microversion: 2.20 time: 0.141290 Sep 13 01:19:10.817414 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 32/73] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:10 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1333 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:19:10.915573 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1c2d1b01-9eba-4124-adb0-a1bcbd2fa601 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:10.931071 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1c2d1b01-9eba-4124-adb0-a1bcbd2fa601 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.269038 Sep 13 01:19:10.932812 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 42/74] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:10 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:11.123627 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d6077db3-88b8-414d-a17b-67c6b0a9acf6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:11.125632 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d6077db3-88b8-414d-a17b-67c6b0a9acf6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:11.133755 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d6077db3-88b8-414d-a17b-67c6b0a9acf6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:11.135451 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d6077db3-88b8-414d-a17b-67c6b0a9acf6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:11.136070 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d6077db3-88b8-414d-a17b-67c6b0a9acf6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:11.137483 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d6077db3-88b8-414d-a17b-67c6b0a9acf6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:11.137944 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d6077db3-88b8-414d-a17b-67c6b0a9acf6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:11.138682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d6077db3-88b8-414d-a17b-67c6b0a9acf6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:11.245947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-76c7c79a-240c-4f22-baee-5e01655f5738 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:11.247136 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-76c7c79a-240c-4f22-baee-5e01655f5738 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:11.254001 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76c7c79a-240c-4f22-baee-5e01655f5738 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:11.254876 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76c7c79a-240c-4f22-baee-5e01655f5738 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:11.255578 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76c7c79a-240c-4f22-baee-5e01655f5738 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:11.256369 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76c7c79a-240c-4f22-baee-5e01655f5738 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:11.257221 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76c7c79a-240c-4f22-baee-5e01655f5738 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:11.257794 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76c7c79a-240c-4f22-baee-5e01655f5738 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:11.337261 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-76c7c79a-240c-4f22-baee-5e01655f5738 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:11.357824 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-76c7c79a-240c-4f22-baee-5e01655f5738 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1295 microversion: 2.1 time: 0.115950 Sep 13 01:19:11.368114 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 43/75] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:11 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1295 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:11.392538 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d6077db3-88b8-414d-a17b-67c6b0a9acf6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:11.407485 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d6077db3-88b8-414d-a17b-67c6b0a9acf6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.282861 Sep 13 01:19:11.414913 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 33/76] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:11 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:11.851791 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e6b303af-a3c7-440c-9f28-a0a37db8cad2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:11.852402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e6b303af-a3c7-440c-9f28-a0a37db8cad2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:11.885536 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6b303af-a3c7-440c-9f28-a0a37db8cad2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:11.888014 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6b303af-a3c7-440c-9f28-a0a37db8cad2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:11.888537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6b303af-a3c7-440c-9f28-a0a37db8cad2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:11.889296 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6b303af-a3c7-440c-9f28-a0a37db8cad2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:11.889812 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6b303af-a3c7-440c-9f28-a0a37db8cad2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:11.890193 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6b303af-a3c7-440c-9f28-a0a37db8cad2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:11.962480 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3c474773-2114-4333-adf4-fa33be5948ba tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:11.963516 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3c474773-2114-4333-adf4-fa33be5948ba tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:11.972725 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3c474773-2114-4333-adf4-fa33be5948ba tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:11.973228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3c474773-2114-4333-adf4-fa33be5948ba tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:11.973701 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3c474773-2114-4333-adf4-fa33be5948ba tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:11.976330 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e6b303af-a3c7-440c-9f28-a0a37db8cad2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:11.976823 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3c474773-2114-4333-adf4-fa33be5948ba tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:11.977321 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3c474773-2114-4333-adf4-fa33be5948ba tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:11.977767 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3c474773-2114-4333-adf4-fa33be5948ba tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:11.985382 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e6b303af-a3c7-440c-9f28-a0a37db8cad2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:11.986816 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e6b303af-a3c7-440c-9f28-a0a37db8cad2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:11.987937 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e6b303af-a3c7-440c-9f28-a0a37db8cad2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1333 microversion: 2.20 time: 0.140124 Sep 13 01:19:11.988482 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 44/77] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:11 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1333 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:12.135672 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3c474773-2114-4333-adf4-fa33be5948ba tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:12.143414 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3c474773-2114-4333-adf4-fa33be5948ba tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.185201 Sep 13 01:19:12.144057 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 34/78] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:11 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:12.382192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-723b8f19-d735-4bc1-ae70-41fad31cbf5d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:12.382831 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-723b8f19-d735-4bc1-ae70-41fad31cbf5d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:12.389098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-723b8f19-d735-4bc1-ae70-41fad31cbf5d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:12.389635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-723b8f19-d735-4bc1-ae70-41fad31cbf5d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:12.390080 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-723b8f19-d735-4bc1-ae70-41fad31cbf5d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:12.390768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-723b8f19-d735-4bc1-ae70-41fad31cbf5d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:12.391794 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-723b8f19-d735-4bc1-ae70-41fad31cbf5d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:12.392221 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-723b8f19-d735-4bc1-ae70-41fad31cbf5d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:12.431073 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-6b049507-ffbb-4fc4-9317-97252e5ddc93 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:12.431910 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-6b049507-ffbb-4fc4-9317-97252e5ddc93 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:12.445544 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6b049507-ffbb-4fc4-9317-97252e5ddc93 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:12.446049 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6b049507-ffbb-4fc4-9317-97252e5ddc93 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:12.446488 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6b049507-ffbb-4fc4-9317-97252e5ddc93 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:12.447251 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6b049507-ffbb-4fc4-9317-97252e5ddc93 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:12.447720 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6b049507-ffbb-4fc4-9317-97252e5ddc93 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:12.448126 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6b049507-ffbb-4fc4-9317-97252e5ddc93 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:12.500145 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-723b8f19-d735-4bc1-ae70-41fad31cbf5d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:12.508000 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-723b8f19-d735-4bc1-ae70-41fad31cbf5d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1295 microversion: 2.1 time: 0.129713 Sep 13 01:19:12.509115 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 45/79] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:12 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1295 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:12.586265 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6b049507-ffbb-4fc4-9317-97252e5ddc93 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:12.606930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-6b049507-ffbb-4fc4-9317-97252e5ddc93 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.167908 Sep 13 01:19:12.606930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 35/80] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:12 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:13.012890 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4b68baa4-adf2-471d-a363-3e621f7d0324 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:13.013498 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4b68baa4-adf2-471d-a363-3e621f7d0324 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:13.019377 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b68baa4-adf2-471d-a363-3e621f7d0324 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:13.019861 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b68baa4-adf2-471d-a363-3e621f7d0324 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:13.020297 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b68baa4-adf2-471d-a363-3e621f7d0324 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:13.020989 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b68baa4-adf2-471d-a363-3e621f7d0324 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:13.021446 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b68baa4-adf2-471d-a363-3e621f7d0324 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:13.021868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b68baa4-adf2-471d-a363-3e621f7d0324 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:13.085498 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4b68baa4-adf2-471d-a363-3e621f7d0324 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:13.094363 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4b68baa4-adf2-471d-a363-3e621f7d0324 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:13.095874 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4b68baa4-adf2-471d-a363-3e621f7d0324 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:13.097078 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4b68baa4-adf2-471d-a363-3e621f7d0324 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1333 microversion: 2.20 time: 0.088104 Sep 13 01:19:13.097624 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 46/81] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:13 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1333 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:13.166570 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-55b889e4-d97b-4818-84c9-8b8bcb90d519 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:13.167204 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-55b889e4-d97b-4818-84c9-8b8bcb90d519 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:13.174410 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-55b889e4-d97b-4818-84c9-8b8bcb90d519 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:13.174999 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-55b889e4-d97b-4818-84c9-8b8bcb90d519 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:13.175501 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-55b889e4-d97b-4818-84c9-8b8bcb90d519 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:13.176328 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-55b889e4-d97b-4818-84c9-8b8bcb90d519 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:13.176854 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-55b889e4-d97b-4818-84c9-8b8bcb90d519 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:13.177284 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-55b889e4-d97b-4818-84c9-8b8bcb90d519 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:13.307984 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-55b889e4-d97b-4818-84c9-8b8bcb90d519 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:13.316471 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-55b889e4-d97b-4818-84c9-8b8bcb90d519 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.153673 Sep 13 01:19:13.317039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 36/82] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:13 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:13.533445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9f68f61d-6526-43b2-bfc2-fc6690e97385 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:13.534495 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9f68f61d-6526-43b2-bfc2-fc6690e97385 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:13.541939 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9f68f61d-6526-43b2-bfc2-fc6690e97385 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:13.542432 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9f68f61d-6526-43b2-bfc2-fc6690e97385 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:13.542897 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9f68f61d-6526-43b2-bfc2-fc6690e97385 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:13.543611 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9f68f61d-6526-43b2-bfc2-fc6690e97385 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:13.544066 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9f68f61d-6526-43b2-bfc2-fc6690e97385 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:13.544643 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9f68f61d-6526-43b2-bfc2-fc6690e97385 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:13.615345 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9f68f61d-6526-43b2-bfc2-fc6690e97385 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:13.620328 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ec05363c-e00e-4b2e-95b2-c6da4bb83204 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:13.621309 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ec05363c-e00e-4b2e-95b2-c6da4bb83204 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:13.624790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9f68f61d-6526-43b2-bfc2-fc6690e97385 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1295 microversion: 2.1 time: 0.096568 Sep 13 01:19:13.625526 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 47/83] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:13 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1295 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:13.637569 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ec05363c-e00e-4b2e-95b2-c6da4bb83204 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:13.639079 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ec05363c-e00e-4b2e-95b2-c6da4bb83204 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:13.640403 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ec05363c-e00e-4b2e-95b2-c6da4bb83204 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:13.641195 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ec05363c-e00e-4b2e-95b2-c6da4bb83204 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:13.641997 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ec05363c-e00e-4b2e-95b2-c6da4bb83204 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:13.642458 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ec05363c-e00e-4b2e-95b2-c6da4bb83204 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:14.143831 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-443a2890-c49a-4574-b4b0-2bd126a0c278 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:14.145958 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-443a2890-c49a-4574-b4b0-2bd126a0c278 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:14.160506 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-443a2890-c49a-4574-b4b0-2bd126a0c278 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:14.164596 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-443a2890-c49a-4574-b4b0-2bd126a0c278 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:14.165061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-443a2890-c49a-4574-b4b0-2bd126a0c278 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:14.166717 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-443a2890-c49a-4574-b4b0-2bd126a0c278 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:14.167709 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-443a2890-c49a-4574-b4b0-2bd126a0c278 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:14.169230 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-443a2890-c49a-4574-b4b0-2bd126a0c278 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:14.235894 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ec05363c-e00e-4b2e-95b2-c6da4bb83204 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:14.247068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ec05363c-e00e-4b2e-95b2-c6da4bb83204 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.627799 Sep 13 01:19:14.247855 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 37/84] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:13 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:14.286546 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-443a2890-c49a-4574-b4b0-2bd126a0c278 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:14.321406 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-443a2890-c49a-4574-b4b0-2bd126a0c278 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:14.323994 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-443a2890-c49a-4574-b4b0-2bd126a0c278 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:14.325550 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-443a2890-c49a-4574-b4b0-2bd126a0c278 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1333 microversion: 2.20 time: 0.206131 Sep 13 01:19:14.327775 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 48/85] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:14 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1333 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:14.349761 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-fb407a29-6777-40d2-bb1c-47bb0599cb05 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:14.350678 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-fb407a29-6777-40d2-bb1c-47bb0599cb05 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:14.368472 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fb407a29-6777-40d2-bb1c-47bb0599cb05 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:14.369628 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fb407a29-6777-40d2-bb1c-47bb0599cb05 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:14.371141 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fb407a29-6777-40d2-bb1c-47bb0599cb05 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:14.373829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fb407a29-6777-40d2-bb1c-47bb0599cb05 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:14.374513 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fb407a29-6777-40d2-bb1c-47bb0599cb05 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:14.375599 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fb407a29-6777-40d2-bb1c-47bb0599cb05 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:14.649699 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3d849a0d-e4a2-4699-b945-6ee741029cda tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:14.650599 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3d849a0d-e4a2-4699-b945-6ee741029cda tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:14.662320 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d849a0d-e4a2-4699-b945-6ee741029cda tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:14.662818 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d849a0d-e4a2-4699-b945-6ee741029cda tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:14.667140 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d849a0d-e4a2-4699-b945-6ee741029cda tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:14.667982 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d849a0d-e4a2-4699-b945-6ee741029cda tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:14.668372 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d849a0d-e4a2-4699-b945-6ee741029cda tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:14.669196 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d849a0d-e4a2-4699-b945-6ee741029cda tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:14.914652 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3d849a0d-e4a2-4699-b945-6ee741029cda tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:14.928163 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3d849a0d-e4a2-4699-b945-6ee741029cda tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1293 microversion: 2.1 time: 0.282449 Sep 13 01:19:14.928823 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 49/86] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:14 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1293 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:15.179719 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-fb407a29-6777-40d2-bb1c-47bb0599cb05 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:15.189299 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-fb407a29-6777-40d2-bb1c-47bb0599cb05 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.854194 Sep 13 01:19:15.191467 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 38/87] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:14 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 857 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:15.272317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3d034533-47d4-497e-884a-b50d7a186199 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:15.273027 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3d034533-47d4-497e-884a-b50d7a186199 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:15.297030 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d034533-47d4-497e-884a-b50d7a186199 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:15.298222 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d034533-47d4-497e-884a-b50d7a186199 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:15.298584 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d034533-47d4-497e-884a-b50d7a186199 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:15.302320 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d034533-47d4-497e-884a-b50d7a186199 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:15.302808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d034533-47d4-497e-884a-b50d7a186199 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:15.306542 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d034533-47d4-497e-884a-b50d7a186199 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:15.351843 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4d7102f0-d33f-42e9-b3b2-4ae648537b73 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:15.352439 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4d7102f0-d33f-42e9-b3b2-4ae648537b73 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:15.361327 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d7102f0-d33f-42e9-b3b2-4ae648537b73 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:15.361996 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d7102f0-d33f-42e9-b3b2-4ae648537b73 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:15.362438 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d7102f0-d33f-42e9-b3b2-4ae648537b73 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:15.363188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d7102f0-d33f-42e9-b3b2-4ae648537b73 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:15.363641 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d7102f0-d33f-42e9-b3b2-4ae648537b73 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:15.364066 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d7102f0-d33f-42e9-b3b2-4ae648537b73 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:15.526455 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4d7102f0-d33f-42e9-b3b2-4ae648537b73 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:15.538565 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4d7102f0-d33f-42e9-b3b2-4ae648537b73 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:15.540793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4d7102f0-d33f-42e9-b3b2-4ae648537b73 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:15.543229 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4d7102f0-d33f-42e9-b3b2-4ae648537b73 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1339 microversion: 2.20 time: 0.195148 Sep 13 01:19:15.544731 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 39/88] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:15 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1339 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:15.937587 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3d034533-47d4-497e-884a-b50d7a186199 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:15.952572 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3d034533-47d4-497e-884a-b50d7a186199 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.684870 Sep 13 01:19:15.953696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 50/89] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:15 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:15.968846 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5f83148a-316c-41bc-9e50-c25cd25ec28f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:15.969467 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5f83148a-316c-41bc-9e50-c25cd25ec28f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:15.982485 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5f83148a-316c-41bc-9e50-c25cd25ec28f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:15.983170 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5f83148a-316c-41bc-9e50-c25cd25ec28f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:15.983632 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5f83148a-316c-41bc-9e50-c25cd25ec28f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:15.984609 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5f83148a-316c-41bc-9e50-c25cd25ec28f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:15.985095 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5f83148a-316c-41bc-9e50-c25cd25ec28f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:15.985697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5f83148a-316c-41bc-9e50-c25cd25ec28f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:16.022740 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:16.073894 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-a0da2d68-79ad-4579-94b8-fd76ec664aa4 req-f790805c-0711-41f0-b2e5-bdb66bae863d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2a24ff77-efd2-4d53-b120-387e032d8e33", "tag": "aa920202-f96d-4a78-9f35-43655e114baf"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:16.111387 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-a0da2d68-79ad-4579-94b8-fd76ec664aa4 req-f790805c-0711-41f0-b2e5-bdb66bae863d service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:16.112156 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-a0da2d68-79ad-4579-94b8-fd76ec664aa4 req-f790805c-0711-41f0-b2e5-bdb66bae863d service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:16.112747 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-a0da2d68-79ad-4579-94b8-fd76ec664aa4 req-f790805c-0711-41f0-b2e5-bdb66bae863d service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:16.140753 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-a0da2d68-79ad-4579-94b8-fd76ec664aa4 req-f790805c-0711-41f0-b2e5-bdb66bae863d service nova] Creating event network-changed:aa920202-f96d-4a78-9f35-43655e114baf for instance 2a24ff77-efd2-4d53-b120-387e032d8e33 on hv-cinder-85694 Sep 13 01:19:16.142095 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-a0da2d68-79ad-4579-94b8-fd76ec664aa4 req-f790805c-0711-41f0-b2e5-bdb66bae863d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120412) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 01:19:16.142669 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-a0da2d68-79ad-4579-94b8-fd76ec664aa4 req-f790805c-0711-41f0-b2e5-bdb66bae863d service nova] Acquired lock "compute-rpcapi-router" {{(pid=120412) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 01:19:16.144047 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-289b1cc6-818e-46d1-aa7b-3cad21f4deb1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:16.144688 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-289b1cc6-818e-46d1-aa7b-3cad21f4deb1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:16.145281 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-289b1cc6-818e-46d1-aa7b-3cad21f4deb1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:16.146224 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-289b1cc6-818e-46d1-aa7b-3cad21f4deb1 None None] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:16.146841 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-289b1cc6-818e-46d1-aa7b-3cad21f4deb1 None None] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:16.147731 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-289b1cc6-818e-46d1-aa7b-3cad21f4deb1 None None] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:16.162235 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.compute.rpcapi [None req-289b1cc6-818e-46d1-aa7b-3cad21f4deb1 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 01:19:16.174038 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-289b1cc6-818e-46d1-aa7b-3cad21f4deb1 None None] Releasing lock "compute-rpcapi-router" {{(pid=120412) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 01:19:16.199330 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-289b1cc6-818e-46d1-aa7b-3cad21f4deb1 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.277534 Sep 13 01:19:16.200137 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5f83148a-316c-41bc-9e50-c25cd25ec28f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:16.201985 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 40/90] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:19:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:19:16.211149 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5f83148a-316c-41bc-9e50-c25cd25ec28f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1293 microversion: 2.1 time: 0.255988 Sep 13 01:19:16.211746 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 51/91] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:15 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1293 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:16.221899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-fd56bce9-e9f3-4258-a377-69393940c494 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:16.222182 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-fd56bce9-e9f3-4258-a377-69393940c494 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:16.245181 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd56bce9-e9f3-4258-a377-69393940c494 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:16.247949 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd56bce9-e9f3-4258-a377-69393940c494 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:16.250288 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd56bce9-e9f3-4258-a377-69393940c494 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:16.251405 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd56bce9-e9f3-4258-a377-69393940c494 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:16.254076 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd56bce9-e9f3-4258-a377-69393940c494 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:16.256885 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd56bce9-e9f3-4258-a377-69393940c494 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:16.570155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0d6b42f3-853b-4821-92dc-58ca91426b7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:16.571461 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0d6b42f3-853b-4821-92dc-58ca91426b7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:16.578431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0d6b42f3-853b-4821-92dc-58ca91426b7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:16.579171 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0d6b42f3-853b-4821-92dc-58ca91426b7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:16.579816 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0d6b42f3-853b-4821-92dc-58ca91426b7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:16.580699 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0d6b42f3-853b-4821-92dc-58ca91426b7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:16.581351 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0d6b42f3-853b-4821-92dc-58ca91426b7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:16.581947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0d6b42f3-853b-4821-92dc-58ca91426b7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:16.706663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0d6b42f3-853b-4821-92dc-58ca91426b7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:16.720409 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0d6b42f3-853b-4821-92dc-58ca91426b7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:16.724401 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0d6b42f3-853b-4821-92dc-58ca91426b7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:16.725906 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0d6b42f3-853b-4821-92dc-58ca91426b7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1339 microversion: 2.20 time: 0.159710 Sep 13 01:19:16.728107 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 52/92] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:16 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1339 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:16.838982 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-fd56bce9-e9f3-4258-a377-69393940c494 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:16.858234 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-fd56bce9-e9f3-4258-a377-69393940c494 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.638955 Sep 13 01:19:16.885816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 41/93] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:16 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:16.980283 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-51b251f6-eb95-4098-aacd-324c07742fbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:16.982520 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-51b251f6-eb95-4098-aacd-324c07742fbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:16.997859 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51b251f6-eb95-4098-aacd-324c07742fbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:17.003582 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51b251f6-eb95-4098-aacd-324c07742fbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:17.004041 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51b251f6-eb95-4098-aacd-324c07742fbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:17.004789 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51b251f6-eb95-4098-aacd-324c07742fbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:17.005248 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51b251f6-eb95-4098-aacd-324c07742fbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:17.006115 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51b251f6-eb95-4098-aacd-324c07742fbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:17.236274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9d68620b-fa09-4177-b26d-028278c82381 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:17.237107 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9d68620b-fa09-4177-b26d-028278c82381 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:17.243554 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9d68620b-fa09-4177-b26d-028278c82381 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:17.244231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9d68620b-fa09-4177-b26d-028278c82381 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:17.244839 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9d68620b-fa09-4177-b26d-028278c82381 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:17.245701 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9d68620b-fa09-4177-b26d-028278c82381 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:17.246826 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9d68620b-fa09-4177-b26d-028278c82381 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:17.247540 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9d68620b-fa09-4177-b26d-028278c82381 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:17.308706 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-51b251f6-eb95-4098-aacd-324c07742fbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:17.332944 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-51b251f6-eb95-4098-aacd-324c07742fbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.359362 Sep 13 01:19:17.334567 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 53/94] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:16 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:17.634285 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-88f88b86-3196-41b3-975a-98d19bb4ec00 req-90722a83-f826-4bba-b1bb-8f03280baf2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0091ed80-cb3c-4dce-b54c-48989fb19e7b", "tag": "af4f2d52-b899-4598-a65e-5404eb758ac3"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:17.668159 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-88f88b86-3196-41b3-975a-98d19bb4ec00 req-90722a83-f826-4bba-b1bb-8f03280baf2b service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:17.668869 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-88f88b86-3196-41b3-975a-98d19bb4ec00 req-90722a83-f826-4bba-b1bb-8f03280baf2b service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:17.669494 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-88f88b86-3196-41b3-975a-98d19bb4ec00 req-90722a83-f826-4bba-b1bb-8f03280baf2b service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:17.687347 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-9d68620b-fa09-4177-b26d-028278c82381 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:17.694331 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-88f88b86-3196-41b3-975a-98d19bb4ec00 req-90722a83-f826-4bba-b1bb-8f03280baf2b service nova] Creating event network-changed:af4f2d52-b899-4598-a65e-5404eb758ac3 for instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b on hv-cinder-85694 Sep 13 01:19:17.695549 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-88f88b86-3196-41b3-975a-98d19bb4ec00 req-90722a83-f826-4bba-b1bb-8f03280baf2b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120415) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 13 01:19:17.695662 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9d68620b-fa09-4177-b26d-028278c82381 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.465277 Sep 13 01:19:17.696182 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-88f88b86-3196-41b3-975a-98d19bb4ec00 req-90722a83-f826-4bba-b1bb-8f03280baf2b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120415) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 13 01:19:17.696312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 42/95] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:17 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:17.697492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-defa59e5-af6b-4be5-856b-d73fcb0b469e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:17.698116 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-defa59e5-af6b-4be5-856b-d73fcb0b469e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:17.698702 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-defa59e5-af6b-4be5-856b-d73fcb0b469e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:17.699591 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-defa59e5-af6b-4be5-856b-d73fcb0b469e None None] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:17.700216 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-defa59e5-af6b-4be5-856b-d73fcb0b469e None None] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:17.700786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-defa59e5-af6b-4be5-856b-d73fcb0b469e None None] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:17.723912 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.compute.rpcapi [None req-defa59e5-af6b-4be5-856b-d73fcb0b469e None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 13 01:19:17.724970 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-defa59e5-af6b-4be5-856b-d73fcb0b469e None None] Releasing lock "compute-rpcapi-router" {{(pid=120415) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 13 01:19:17.743103 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-defa59e5-af6b-4be5-856b-d73fcb0b469e None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.226771 Sep 13 01:19:17.743725 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 54/96] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:19:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:19:17.758513 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-106c4864-3549-40d6-afe4-c4ee1bf90442 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:17.759181 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-106c4864-3549-40d6-afe4-c4ee1bf90442 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:17.767069 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-106c4864-3549-40d6-afe4-c4ee1bf90442 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:17.767780 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-106c4864-3549-40d6-afe4-c4ee1bf90442 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:17.768378 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-106c4864-3549-40d6-afe4-c4ee1bf90442 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:17.769142 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-106c4864-3549-40d6-afe4-c4ee1bf90442 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:17.769744 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-106c4864-3549-40d6-afe4-c4ee1bf90442 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:17.770170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-106c4864-3549-40d6-afe4-c4ee1bf90442 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:17.898462 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b8dde206-a657-472c-be09-1271a1b39cfa tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:17.899206 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b8dde206-a657-472c-be09-1271a1b39cfa tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:17.908763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b8dde206-a657-472c-be09-1271a1b39cfa tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:17.909137 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b8dde206-a657-472c-be09-1271a1b39cfa tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:17.909632 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b8dde206-a657-472c-be09-1271a1b39cfa tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:17.914462 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b8dde206-a657-472c-be09-1271a1b39cfa tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:17.915079 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b8dde206-a657-472c-be09-1271a1b39cfa tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:17.915733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b8dde206-a657-472c-be09-1271a1b39cfa tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:17.940936 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-106c4864-3549-40d6-afe4-c4ee1bf90442 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:17.951059 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-106c4864-3549-40d6-afe4-c4ee1bf90442 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:17.953030 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-106c4864-3549-40d6-afe4-c4ee1bf90442 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:17.954313 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-106c4864-3549-40d6-afe4-c4ee1bf90442 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.206423 Sep 13 01:19:17.956247 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 43/97] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:17 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:18.076616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b8dde206-a657-472c-be09-1271a1b39cfa tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:18.087127 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b8dde206-a657-472c-be09-1271a1b39cfa tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.193080 Sep 13 01:19:18.096093 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 55/98] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:17 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:18.231197 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-f28c43c9-03e7-4e16-a381-0ef9154cae6a req-c20c6a59-74f7-4c19-bf06-591513c58234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e628b0a-c70b-4c2b-b98e-339abc492871", "tag": "1a2cf032-3cde-45a3-9e82-737d704d0b9f"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:18.240361 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-f28c43c9-03e7-4e16-a381-0ef9154cae6a req-c20c6a59-74f7-4c19-bf06-591513c58234 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:18.240836 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-f28c43c9-03e7-4e16-a381-0ef9154cae6a req-c20c6a59-74f7-4c19-bf06-591513c58234 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:18.241260 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-f28c43c9-03e7-4e16-a381-0ef9154cae6a req-c20c6a59-74f7-4c19-bf06-591513c58234 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:18.252257 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-f28c43c9-03e7-4e16-a381-0ef9154cae6a req-c20c6a59-74f7-4c19-bf06-591513c58234 service nova] Creating event network-changed:1a2cf032-3cde-45a3-9e82-737d704d0b9f for instance 2e628b0a-c70b-4c2b-b98e-339abc492871 on hv-cinder-85694 Sep 13 01:19:18.257031 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-f28c43c9-03e7-4e16-a381-0ef9154cae6a req-c20c6a59-74f7-4c19-bf06-591513c58234 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029493 Sep 13 01:19:18.257598 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 44/99] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:19:18.370497 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1a0477b7-56bd-40a5-b0d1-f60320dc7b55 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:18.371071 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1a0477b7-56bd-40a5-b0d1-f60320dc7b55 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:18.377517 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a0477b7-56bd-40a5-b0d1-f60320dc7b55 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:18.377989 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a0477b7-56bd-40a5-b0d1-f60320dc7b55 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:18.378413 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a0477b7-56bd-40a5-b0d1-f60320dc7b55 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:18.379118 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a0477b7-56bd-40a5-b0d1-f60320dc7b55 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:18.379561 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a0477b7-56bd-40a5-b0d1-f60320dc7b55 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:18.379975 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a0477b7-56bd-40a5-b0d1-f60320dc7b55 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:18.504299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1a0477b7-56bd-40a5-b0d1-f60320dc7b55 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:18.511925 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1a0477b7-56bd-40a5-b0d1-f60320dc7b55 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.145337 Sep 13 01:19:18.512531 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 56/100] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:18 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:18.722378 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b8974da6-e437-46fd-9b41-7933e1a1f607 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:18.723149 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b8974da6-e437-46fd-9b41-7933e1a1f607 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:18.729295 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b8974da6-e437-46fd-9b41-7933e1a1f607 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:18.729782 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b8974da6-e437-46fd-9b41-7933e1a1f607 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:18.730219 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b8974da6-e437-46fd-9b41-7933e1a1f607 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:18.730944 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b8974da6-e437-46fd-9b41-7933e1a1f607 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:18.731399 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b8974da6-e437-46fd-9b41-7933e1a1f607 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:18.731821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b8974da6-e437-46fd-9b41-7933e1a1f607 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:18.861016 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b8974da6-e437-46fd-9b41-7933e1a1f607 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:18.868718 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b8974da6-e437-46fd-9b41-7933e1a1f607 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.150641 Sep 13 01:19:18.869295 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 45/101] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:18 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:18.981601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7b27203d-5094-424d-9ee8-b87fd9db076a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:18.982125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7b27203d-5094-424d-9ee8-b87fd9db076a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:18.988948 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b27203d-5094-424d-9ee8-b87fd9db076a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:18.989429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b27203d-5094-424d-9ee8-b87fd9db076a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:18.989864 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b27203d-5094-424d-9ee8-b87fd9db076a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:18.990550 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b27203d-5094-424d-9ee8-b87fd9db076a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:18.991040 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b27203d-5094-424d-9ee8-b87fd9db076a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:18.991460 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b27203d-5094-424d-9ee8-b87fd9db076a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:19.122060 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-2f3fb487-21b0-4ecc-b05a-9d1db70e30da tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:19.122751 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-2f3fb487-21b0-4ecc-b05a-9d1db70e30da tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:19.123137 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7b27203d-5094-424d-9ee8-b87fd9db076a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:19.129276 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f3fb487-21b0-4ecc-b05a-9d1db70e30da tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:19.130060 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f3fb487-21b0-4ecc-b05a-9d1db70e30da tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:19.130600 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f3fb487-21b0-4ecc-b05a-9d1db70e30da tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:19.131534 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f3fb487-21b0-4ecc-b05a-9d1db70e30da tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:19.132367 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f3fb487-21b0-4ecc-b05a-9d1db70e30da tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:19.132897 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f3fb487-21b0-4ecc-b05a-9d1db70e30da tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:19.133017 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7b27203d-5094-424d-9ee8-b87fd9db076a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:19.134508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7b27203d-5094-424d-9ee8-b87fd9db076a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:19.135716 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7b27203d-5094-424d-9ee8-b87fd9db076a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.158114 Sep 13 01:19:19.136278 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 57/102] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:18 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:19.270845 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2f3fb487-21b0-4ecc-b05a-9d1db70e30da tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:19.278816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-2f3fb487-21b0-4ecc-b05a-9d1db70e30da tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.161749 Sep 13 01:19:19.279404 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 46/103] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:19 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:19.534897 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7660e0ce-8123-41ca-b0d9-61907cf12d63 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:19.535607 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7660e0ce-8123-41ca-b0d9-61907cf12d63 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:19.543916 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7660e0ce-8123-41ca-b0d9-61907cf12d63 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:19.546042 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7660e0ce-8123-41ca-b0d9-61907cf12d63 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:19.546948 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7660e0ce-8123-41ca-b0d9-61907cf12d63 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:19.547930 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7660e0ce-8123-41ca-b0d9-61907cf12d63 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:19.548635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7660e0ce-8123-41ca-b0d9-61907cf12d63 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:19.553125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7660e0ce-8123-41ca-b0d9-61907cf12d63 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:19.759875 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7660e0ce-8123-41ca-b0d9-61907cf12d63 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:19.769784 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7660e0ce-8123-41ca-b0d9-61907cf12d63 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.238853 Sep 13 01:19:19.770622 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 58/104] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:19 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:19.892774 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1456ab96-c3c6-4f27-bdf2-70609ae2d1f5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:19.903409 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1456ab96-c3c6-4f27-bdf2-70609ae2d1f5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:19.911179 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1456ab96-c3c6-4f27-bdf2-70609ae2d1f5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:19.911672 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1456ab96-c3c6-4f27-bdf2-70609ae2d1f5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:19.912205 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1456ab96-c3c6-4f27-bdf2-70609ae2d1f5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:19.913498 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1456ab96-c3c6-4f27-bdf2-70609ae2d1f5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:19.913969 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1456ab96-c3c6-4f27-bdf2-70609ae2d1f5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:19.914392 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1456ab96-c3c6-4f27-bdf2-70609ae2d1f5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:19.919261 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=100 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:20.161558 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9d388fea-6326-4e1d-b184-c03524b984e4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:20.162197 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9d388fea-6326-4e1d-b184-c03524b984e4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:20.168374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9d388fea-6326-4e1d-b184-c03524b984e4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:20.168906 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9d388fea-6326-4e1d-b184-c03524b984e4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:20.169384 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9d388fea-6326-4e1d-b184-c03524b984e4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:20.170924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9d388fea-6326-4e1d-b184-c03524b984e4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:20.171460 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9d388fea-6326-4e1d-b184-c03524b984e4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:20.172045 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9d388fea-6326-4e1d-b184-c03524b984e4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:20.207537 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1456ab96-c3c6-4f27-bdf2-70609ae2d1f5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:20.218015 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1456ab96-c3c6-4f27-bdf2-70609ae2d1f5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.329695 Sep 13 01:19:20.232412 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 47/105] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:19 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:20.302729 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f24e0b25-ad14-4a77-96a3-5cc47ef1e619 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:20.303451 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-f24e0b25-ad14-4a77-96a3-5cc47ef1e619 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:20.318740 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f24e0b25-ad14-4a77-96a3-5cc47ef1e619 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:20.319624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f24e0b25-ad14-4a77-96a3-5cc47ef1e619 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:20.322720 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f24e0b25-ad14-4a77-96a3-5cc47ef1e619 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:20.326793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f24e0b25-ad14-4a77-96a3-5cc47ef1e619 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:20.329097 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f24e0b25-ad14-4a77-96a3-5cc47ef1e619 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:20.330295 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f24e0b25-ad14-4a77-96a3-5cc47ef1e619 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:20.378697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9d388fea-6326-4e1d-b184-c03524b984e4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:20.389668 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9d388fea-6326-4e1d-b184-c03524b984e4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:20.392327 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9d388fea-6326-4e1d-b184-c03524b984e4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:20.393895 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9d388fea-6326-4e1d-b184-c03524b984e4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.236940 Sep 13 01:19:20.395140 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 59/106] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:20 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:19:20.793575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cc115390-bc6c-4d32-a801-2552553470dd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:20.794431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cc115390-bc6c-4d32-a801-2552553470dd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:20.801193 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc115390-bc6c-4d32-a801-2552553470dd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:20.801692 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc115390-bc6c-4d32-a801-2552553470dd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:20.802132 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc115390-bc6c-4d32-a801-2552553470dd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:20.803006 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc115390-bc6c-4d32-a801-2552553470dd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:20.803468 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc115390-bc6c-4d32-a801-2552553470dd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:20.803896 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc115390-bc6c-4d32-a801-2552553470dd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:20.946012 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f24e0b25-ad14-4a77-96a3-5cc47ef1e619 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:20.956880 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f24e0b25-ad14-4a77-96a3-5cc47ef1e619 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.658441 Sep 13 01:19:20.958149 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 48/107] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:20 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:21.186553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cc115390-bc6c-4d32-a801-2552553470dd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:21.200812 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cc115390-bc6c-4d32-a801-2552553470dd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.409813 Sep 13 01:19:21.203841 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 60/108] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:20 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:21.243170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4d26c304-827e-491e-bcb8-535011002a65 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:21.244538 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4d26c304-827e-491e-bcb8-535011002a65 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:21.252711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d26c304-827e-491e-bcb8-535011002a65 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:21.253565 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d26c304-827e-491e-bcb8-535011002a65 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:21.254395 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d26c304-827e-491e-bcb8-535011002a65 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:21.255798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d26c304-827e-491e-bcb8-535011002a65 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:21.256759 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d26c304-827e-491e-bcb8-535011002a65 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:21.257558 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d26c304-827e-491e-bcb8-535011002a65 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:21.285019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-7eece9d4-a5d5-4a36-8401-dfe89f6ceb91 req-c29fe1e9-36bc-4b10-bba0-a77eaf927a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85de1ecb-9d12-49d4-b0cd-4631e36357d3", "tag": "fd07ce18-daad-47e8-8e34-3a96d4e32e60"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:21.331174 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-7eece9d4-a5d5-4a36-8401-dfe89f6ceb91 req-c29fe1e9-36bc-4b10-bba0-a77eaf927a79 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:21.335908 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-7eece9d4-a5d5-4a36-8401-dfe89f6ceb91 req-c29fe1e9-36bc-4b10-bba0-a77eaf927a79 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:21.336546 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-7eece9d4-a5d5-4a36-8401-dfe89f6ceb91 req-c29fe1e9-36bc-4b10-bba0-a77eaf927a79 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:21.382611 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-7eece9d4-a5d5-4a36-8401-dfe89f6ceb91 req-c29fe1e9-36bc-4b10-bba0-a77eaf927a79 service nova] Creating event network-changed:fd07ce18-daad-47e8-8e34-3a96d4e32e60 for instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 on hv-cinder-85694 Sep 13 01:19:21.388199 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-7eece9d4-a5d5-4a36-8401-dfe89f6ceb91 req-c29fe1e9-36bc-4b10-bba0-a77eaf927a79 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109228 Sep 13 01:19:21.389413 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 61/109] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:19:21.430784 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e92013a7-2bd7-4098-88d1-95ba77c3387f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:21.443146 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e92013a7-2bd7-4098-88d1-95ba77c3387f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:21.467839 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e92013a7-2bd7-4098-88d1-95ba77c3387f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:21.468588 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e92013a7-2bd7-4098-88d1-95ba77c3387f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:21.472543 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e92013a7-2bd7-4098-88d1-95ba77c3387f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:21.473882 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e92013a7-2bd7-4098-88d1-95ba77c3387f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:21.474353 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e92013a7-2bd7-4098-88d1-95ba77c3387f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:21.475099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e92013a7-2bd7-4098-88d1-95ba77c3387f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:21.617443 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4d26c304-827e-491e-bcb8-535011002a65 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:21.625344 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4d26c304-827e-491e-bcb8-535011002a65 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.386227 Sep 13 01:19:21.626215 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 49/110] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:21 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:21.642784 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e92013a7-2bd7-4098-88d1-95ba77c3387f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:21.651781 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e92013a7-2bd7-4098-88d1-95ba77c3387f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:21.658559 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e92013a7-2bd7-4098-88d1-95ba77c3387f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:21.660096 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e92013a7-2bd7-4098-88d1-95ba77c3387f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.238126 Sep 13 01:19:21.660976 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 62/111] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:21 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:21.991261 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c672532f-768d-4693-b9bb-40306cddf605 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:21.991884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c672532f-768d-4693-b9bb-40306cddf605 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:22.000768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c672532f-768d-4693-b9bb-40306cddf605 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:22.001517 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c672532f-768d-4693-b9bb-40306cddf605 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:22.001962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c672532f-768d-4693-b9bb-40306cddf605 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:22.002675 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c672532f-768d-4693-b9bb-40306cddf605 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:22.003170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c672532f-768d-4693-b9bb-40306cddf605 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:22.003606 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c672532f-768d-4693-b9bb-40306cddf605 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:22.156374 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c672532f-768d-4693-b9bb-40306cddf605 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:22.164237 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c672532f-768d-4693-b9bb-40306cddf605 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.177170 Sep 13 01:19:22.164899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 50/112] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:21 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:22.226404 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-396873a9-d7a7-4272-933a-78a3a0751c21 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:22.227132 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-396873a9-d7a7-4272-933a-78a3a0751c21 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:22.233572 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-396873a9-d7a7-4272-933a-78a3a0751c21 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:22.234048 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-396873a9-d7a7-4272-933a-78a3a0751c21 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:22.234496 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-396873a9-d7a7-4272-933a-78a3a0751c21 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:22.235208 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-396873a9-d7a7-4272-933a-78a3a0751c21 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:22.235661 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-396873a9-d7a7-4272-933a-78a3a0751c21 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:22.236112 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-396873a9-d7a7-4272-933a-78a3a0751c21 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:22.656067 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5ac6b5ce-ff23-4dbf-876f-e6672cd6f9a8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:22.657275 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-5ac6b5ce-ff23-4dbf-876f-e6672cd6f9a8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:22.665673 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5ac6b5ce-ff23-4dbf-876f-e6672cd6f9a8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:22.666380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5ac6b5ce-ff23-4dbf-876f-e6672cd6f9a8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:22.667210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5ac6b5ce-ff23-4dbf-876f-e6672cd6f9a8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:22.668978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5ac6b5ce-ff23-4dbf-876f-e6672cd6f9a8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:22.669603 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5ac6b5ce-ff23-4dbf-876f-e6672cd6f9a8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:22.670720 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5ac6b5ce-ff23-4dbf-876f-e6672cd6f9a8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:22.773719 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-396873a9-d7a7-4272-933a-78a3a0751c21 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:22.784636 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-396873a9-d7a7-4272-933a-78a3a0751c21 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.561918 Sep 13 01:19:22.785238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 63/113] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:22 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:22.789865 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9e927a22-0a8a-4477-8a0e-08f91f24e76a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:22.790871 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9e927a22-0a8a-4477-8a0e-08f91f24e76a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:22.796917 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e927a22-0a8a-4477-8a0e-08f91f24e76a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:22.797562 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e927a22-0a8a-4477-8a0e-08f91f24e76a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:22.798138 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e927a22-0a8a-4477-8a0e-08f91f24e76a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:22.799020 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e927a22-0a8a-4477-8a0e-08f91f24e76a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:22.799604 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e927a22-0a8a-4477-8a0e-08f91f24e76a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:22.800200 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e927a22-0a8a-4477-8a0e-08f91f24e76a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:22.820316 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5ac6b5ce-ff23-4dbf-876f-e6672cd6f9a8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:22.828709 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-5ac6b5ce-ff23-4dbf-876f-e6672cd6f9a8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.178589 Sep 13 01:19:22.843496 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 51/114] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:22 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:22.945758 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9e927a22-0a8a-4477-8a0e-08f91f24e76a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:22.954171 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9e927a22-0a8a-4477-8a0e-08f91f24e76a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:22.955643 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9e927a22-0a8a-4477-8a0e-08f91f24e76a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:22.956742 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9e927a22-0a8a-4477-8a0e-08f91f24e76a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.170444 Sep 13 01:19:22.957362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 64/115] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:22 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:23.190260 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4c49f9b7-c1e0-4990-b5c1-8e72eefad1a5 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:23.190908 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4c49f9b7-c1e0-4990-b5c1-8e72eefad1a5 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:23.196950 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4c49f9b7-c1e0-4990-b5c1-8e72eefad1a5 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:23.197492 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4c49f9b7-c1e0-4990-b5c1-8e72eefad1a5 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:23.197943 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4c49f9b7-c1e0-4990-b5c1-8e72eefad1a5 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:23.199082 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4c49f9b7-c1e0-4990-b5c1-8e72eefad1a5 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:23.199784 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4c49f9b7-c1e0-4990-b5c1-8e72eefad1a5 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:23.200323 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4c49f9b7-c1e0-4990-b5c1-8e72eefad1a5 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:23.447349 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-10f81051-7715-4812-be74-0f3ab84468d9 req-891ccfc3-fbd6-4cd1-ac80-7e9ba124b254 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1677b90a-17f0-496f-8fce-ac573509c1ac", "tag": "88cd16db-1d4f-46f0-9069-3f6713e3efbd"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:23.475282 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-10f81051-7715-4812-be74-0f3ab84468d9 req-891ccfc3-fbd6-4cd1-ac80-7e9ba124b254 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:23.475883 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-10f81051-7715-4812-be74-0f3ab84468d9 req-891ccfc3-fbd6-4cd1-ac80-7e9ba124b254 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:23.477487 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-10f81051-7715-4812-be74-0f3ab84468d9 req-891ccfc3-fbd6-4cd1-ac80-7e9ba124b254 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:23.508049 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-10f81051-7715-4812-be74-0f3ab84468d9 req-891ccfc3-fbd6-4cd1-ac80-7e9ba124b254 service nova] Creating event network-changed:88cd16db-1d4f-46f0-9069-3f6713e3efbd for instance 1677b90a-17f0-496f-8fce-ac573509c1ac on hv-cinder-85694 Sep 13 01:19:23.521546 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-10f81051-7715-4812-be74-0f3ab84468d9 req-891ccfc3-fbd6-4cd1-ac80-7e9ba124b254 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077288 Sep 13 01:19:23.522527 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 65/116] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:19:23.808967 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-27ace750-7aa5-4051-bafb-9781a65ec8d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:23.809723 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-27ace750-7aa5-4051-bafb-9781a65ec8d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:23.818673 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27ace750-7aa5-4051-bafb-9781a65ec8d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:23.819305 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27ace750-7aa5-4051-bafb-9781a65ec8d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:23.819806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27ace750-7aa5-4051-bafb-9781a65ec8d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:23.820760 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27ace750-7aa5-4051-bafb-9781a65ec8d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:23.821289 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27ace750-7aa5-4051-bafb-9781a65ec8d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:23.821933 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-27ace750-7aa5-4051-bafb-9781a65ec8d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:23.897262 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4c49f9b7-c1e0-4990-b5c1-8e72eefad1a5 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:23.905167 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4c49f9b7-c1e0-4990-b5c1-8e72eefad1a5 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.720883 Sep 13 01:19:23.906048 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 52/117] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:23 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:23.910846 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-57f7568a-cc51-4579-8aaf-354ad20b8425 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:23.911754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-57f7568a-cc51-4579-8aaf-354ad20b8425 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:23.917927 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-57f7568a-cc51-4579-8aaf-354ad20b8425 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:23.918764 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-57f7568a-cc51-4579-8aaf-354ad20b8425 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:23.919443 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-57f7568a-cc51-4579-8aaf-354ad20b8425 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:23.921005 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-57f7568a-cc51-4579-8aaf-354ad20b8425 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:23.921669 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-57f7568a-cc51-4579-8aaf-354ad20b8425 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:23.922301 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-57f7568a-cc51-4579-8aaf-354ad20b8425 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:24.009222 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-27ace750-7aa5-4051-bafb-9781a65ec8d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:24.019499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-27ace750-7aa5-4051-bafb-9781a65ec8d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.215333 Sep 13 01:19:24.020424 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 66/118] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:23 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:24.029935 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e78f8fef-3225-4135-aac5-a39bbab59490 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:24.031580 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e78f8fef-3225-4135-aac5-a39bbab59490 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:24.037766 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e78f8fef-3225-4135-aac5-a39bbab59490 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:24.038565 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e78f8fef-3225-4135-aac5-a39bbab59490 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:24.039119 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e78f8fef-3225-4135-aac5-a39bbab59490 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:24.039898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e78f8fef-3225-4135-aac5-a39bbab59490 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:24.040425 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e78f8fef-3225-4135-aac5-a39bbab59490 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:24.040919 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e78f8fef-3225-4135-aac5-a39bbab59490 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:24.217064 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e78f8fef-3225-4135-aac5-a39bbab59490 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:24.227322 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e78f8fef-3225-4135-aac5-a39bbab59490 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:24.229136 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e78f8fef-3225-4135-aac5-a39bbab59490 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:24.231239 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e78f8fef-3225-4135-aac5-a39bbab59490 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.208425 Sep 13 01:19:24.232392 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 67/119] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:24 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:24.344877 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-57f7568a-cc51-4579-8aaf-354ad20b8425 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:24.353375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-57f7568a-cc51-4579-8aaf-354ad20b8425 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.445912 Sep 13 01:19:24.354026 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 53/120] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:23 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:24.936592 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f5c61bef-10a4-4b67-96b0-446f9ef1edad tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:24.939306 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f5c61bef-10a4-4b67-96b0-446f9ef1edad tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:24.955421 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5c61bef-10a4-4b67-96b0-446f9ef1edad tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:24.956432 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5c61bef-10a4-4b67-96b0-446f9ef1edad tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:24.957077 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5c61bef-10a4-4b67-96b0-446f9ef1edad tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:24.958301 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5c61bef-10a4-4b67-96b0-446f9ef1edad tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:24.959095 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5c61bef-10a4-4b67-96b0-446f9ef1edad tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:24.959909 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5c61bef-10a4-4b67-96b0-446f9ef1edad tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:25.043760 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0bc096d6-6c15-44c3-be1c-0bb05ab60c80 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:25.045301 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0bc096d6-6c15-44c3-be1c-0bb05ab60c80 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:25.051984 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bc096d6-6c15-44c3-be1c-0bb05ab60c80 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:25.052840 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bc096d6-6c15-44c3-be1c-0bb05ab60c80 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:25.053491 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bc096d6-6c15-44c3-be1c-0bb05ab60c80 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:25.054544 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bc096d6-6c15-44c3-be1c-0bb05ab60c80 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:25.055235 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bc096d6-6c15-44c3-be1c-0bb05ab60c80 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:25.055899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bc096d6-6c15-44c3-be1c-0bb05ab60c80 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:25.184287 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f5c61bef-10a4-4b67-96b0-446f9ef1edad tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:25.193795 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f5c61bef-10a4-4b67-96b0-446f9ef1edad tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.266887 Sep 13 01:19:25.194889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 68/121] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:24 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:25.260007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d66e2634-d889-4aaa-b044-8b2bfafb59f2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:25.261117 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d66e2634-d889-4aaa-b044-8b2bfafb59f2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:25.272727 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d66e2634-d889-4aaa-b044-8b2bfafb59f2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:25.273793 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d66e2634-d889-4aaa-b044-8b2bfafb59f2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:25.274465 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d66e2634-d889-4aaa-b044-8b2bfafb59f2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:25.275880 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d66e2634-d889-4aaa-b044-8b2bfafb59f2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:25.276588 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d66e2634-d889-4aaa-b044-8b2bfafb59f2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:25.277442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d66e2634-d889-4aaa-b044-8b2bfafb59f2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:25.386416 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0bc096d6-6c15-44c3-be1c-0bb05ab60c80 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:25.396295 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0bc096d6-6c15-44c3-be1c-0bb05ab60c80 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.356178 Sep 13 01:19:25.396894 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 54/122] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:25 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:25.423083 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7bad9bbe-75a1-4ea3-98f1-8fda108e7a68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:25.425950 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7bad9bbe-75a1-4ea3-98f1-8fda108e7a68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:25.441615 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7bad9bbe-75a1-4ea3-98f1-8fda108e7a68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:25.443146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7bad9bbe-75a1-4ea3-98f1-8fda108e7a68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:25.445337 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7bad9bbe-75a1-4ea3-98f1-8fda108e7a68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:25.446264 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7bad9bbe-75a1-4ea3-98f1-8fda108e7a68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:25.447797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7bad9bbe-75a1-4ea3-98f1-8fda108e7a68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:25.448571 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7bad9bbe-75a1-4ea3-98f1-8fda108e7a68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:25.477670 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d66e2634-d889-4aaa-b044-8b2bfafb59f2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:25.481472 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:25.496841 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d66e2634-d889-4aaa-b044-8b2bfafb59f2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:25.499098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d66e2634-d889-4aaa-b044-8b2bfafb59f2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:25.500634 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d66e2634-d889-4aaa-b044-8b2bfafb59f2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.247359 Sep 13 01:19:25.516825 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 69/123] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:25 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:25.900826 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7bad9bbe-75a1-4ea3-98f1-8fda108e7a68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:25.911035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7bad9bbe-75a1-4ea3-98f1-8fda108e7a68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.513048 Sep 13 01:19:25.911631 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 55/124] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:25 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:26.222959 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-dd24e9a7-6fdd-4c26-b922-475afc59d784 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:26.223582 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-dd24e9a7-6fdd-4c26-b922-475afc59d784 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:26.236496 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd24e9a7-6fdd-4c26-b922-475afc59d784 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:26.237588 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd24e9a7-6fdd-4c26-b922-475afc59d784 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:26.238185 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd24e9a7-6fdd-4c26-b922-475afc59d784 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:26.240673 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd24e9a7-6fdd-4c26-b922-475afc59d784 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:26.241325 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd24e9a7-6fdd-4c26-b922-475afc59d784 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:26.245133 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dd24e9a7-6fdd-4c26-b922-475afc59d784 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:26.424157 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-262fdb57-9f80-44c8-82c8-785d08d4dffe tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:26.425481 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-262fdb57-9f80-44c8-82c8-785d08d4dffe tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:26.434699 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:26.450674 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-262fdb57-9f80-44c8-82c8-785d08d4dffe tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:26.455639 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-262fdb57-9f80-44c8-82c8-785d08d4dffe tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:26.458618 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-262fdb57-9f80-44c8-82c8-785d08d4dffe tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:26.461286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-262fdb57-9f80-44c8-82c8-785d08d4dffe tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:26.463549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-262fdb57-9f80-44c8-82c8-785d08d4dffe tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:26.464736 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-262fdb57-9f80-44c8-82c8-785d08d4dffe tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:26.667442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-dd24e9a7-6fdd-4c26-b922-475afc59d784 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:26.675409 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-dd24e9a7-6fdd-4c26-b922-475afc59d784 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.457370 Sep 13 01:19:26.679891 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 70/125] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:26 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:27.091735 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-262fdb57-9f80-44c8-82c8-785d08d4dffe tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:27.105069 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-262fdb57-9f80-44c8-82c8-785d08d4dffe tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.686072 Sep 13 01:19:27.109435 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 56/126] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:26 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:27.126546 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-dce60b9a-7516-46b3-bfd5-c64b3d139ab3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:27.130936 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-dce60b9a-7516-46b3-bfd5-c64b3d139ab3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:27.150016 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dce60b9a-7516-46b3-bfd5-c64b3d139ab3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:27.151425 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dce60b9a-7516-46b3-bfd5-c64b3d139ab3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:27.153607 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dce60b9a-7516-46b3-bfd5-c64b3d139ab3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:27.155139 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dce60b9a-7516-46b3-bfd5-c64b3d139ab3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:27.158082 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dce60b9a-7516-46b3-bfd5-c64b3d139ab3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:27.159657 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dce60b9a-7516-46b3-bfd5-c64b3d139ab3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:27.323617 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-8a3a0351-fafc-4aef-bc99-e3bdec83b14f req-00f2a70d-f2b8-423b-bb09-61e58f59b35c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0091ed80-cb3c-4dce-b54c-48989fb19e7b", "name": "network-vif-plugged", "status": "completed", "tag": "af4f2d52-b899-4598-a65e-5404eb758ac3"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:27.345492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-8a3a0351-fafc-4aef-bc99-e3bdec83b14f req-00f2a70d-f2b8-423b-bb09-61e58f59b35c service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:27.346441 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-8a3a0351-fafc-4aef-bc99-e3bdec83b14f req-00f2a70d-f2b8-423b-bb09-61e58f59b35c service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:27.347267 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-8a3a0351-fafc-4aef-bc99-e3bdec83b14f req-00f2a70d-f2b8-423b-bb09-61e58f59b35c service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:27.387979 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-8a3a0351-fafc-4aef-bc99-e3bdec83b14f req-00f2a70d-f2b8-423b-bb09-61e58f59b35c service nova] Creating event network-vif-plugged:af4f2d52-b899-4598-a65e-5404eb758ac3 for instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b on hv-cinder-85694 Sep 13 01:19:27.394436 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-8a3a0351-fafc-4aef-bc99-e3bdec83b14f req-00f2a70d-f2b8-423b-bb09-61e58f59b35c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.702048 Sep 13 01:19:27.395245 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 71/127] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:19:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:19:27.401462 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d707de43-333e-46b4-a1c4-fbeafaf53903 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:27.402319 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d707de43-333e-46b4-a1c4-fbeafaf53903 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:27.428115 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d707de43-333e-46b4-a1c4-fbeafaf53903 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:27.429051 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d707de43-333e-46b4-a1c4-fbeafaf53903 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:27.429673 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d707de43-333e-46b4-a1c4-fbeafaf53903 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:27.431056 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d707de43-333e-46b4-a1c4-fbeafaf53903 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:27.431713 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d707de43-333e-46b4-a1c4-fbeafaf53903 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:27.432206 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d707de43-333e-46b4-a1c4-fbeafaf53903 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:27.481336 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-dce60b9a-7516-46b3-bfd5-c64b3d139ab3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:27.493716 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-dce60b9a-7516-46b3-bfd5-c64b3d139ab3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:27.496413 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-dce60b9a-7516-46b3-bfd5-c64b3d139ab3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:27.497968 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-dce60b9a-7516-46b3-bfd5-c64b3d139ab3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.386011 Sep 13 01:19:27.499312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 57/128] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:27 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:27.717239 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ac6521ed-efef-4e71-a91b-eeca862a5374 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:27.719506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ac6521ed-efef-4e71-a91b-eeca862a5374 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:27.721074 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:27.730363 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ac6521ed-efef-4e71-a91b-eeca862a5374 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:27.730939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ac6521ed-efef-4e71-a91b-eeca862a5374 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:27.731726 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ac6521ed-efef-4e71-a91b-eeca862a5374 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:27.734012 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ac6521ed-efef-4e71-a91b-eeca862a5374 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:27.734760 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ac6521ed-efef-4e71-a91b-eeca862a5374 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:27.735612 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ac6521ed-efef-4e71-a91b-eeca862a5374 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:27.762472 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d707de43-333e-46b4-a1c4-fbeafaf53903 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:27.773647 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d707de43-333e-46b4-a1c4-fbeafaf53903 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.377021 Sep 13 01:19:27.774246 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 72/129] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:27 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:28.119633 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ac6521ed-efef-4e71-a91b-eeca862a5374 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:28.133043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2b0ebd2d-c5ae-4c27-8c5e-ca1b03e6ed33 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:28.133848 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2b0ebd2d-c5ae-4c27-8c5e-ca1b03e6ed33 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:28.145059 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ac6521ed-efef-4e71-a91b-eeca862a5374 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.440125 Sep 13 01:19:28.146951 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2b0ebd2d-c5ae-4c27-8c5e-ca1b03e6ed33 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:28.147431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 58/130] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:27 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:28.148198 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2b0ebd2d-c5ae-4c27-8c5e-ca1b03e6ed33 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:28.148827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2b0ebd2d-c5ae-4c27-8c5e-ca1b03e6ed33 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:28.149847 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2b0ebd2d-c5ae-4c27-8c5e-ca1b03e6ed33 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:28.150514 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2b0ebd2d-c5ae-4c27-8c5e-ca1b03e6ed33 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:28.151156 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2b0ebd2d-c5ae-4c27-8c5e-ca1b03e6ed33 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:28.439020 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2b0ebd2d-c5ae-4c27-8c5e-ca1b03e6ed33 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:28.449801 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2b0ebd2d-c5ae-4c27-8c5e-ca1b03e6ed33 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.321020 Sep 13 01:19:28.450408 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 73/131] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:28 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:28.523729 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-62f41112-0c09-4463-b71d-92c75f3dba7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:28.528944 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-62f41112-0c09-4463-b71d-92c75f3dba7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:28.534958 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-62f41112-0c09-4463-b71d-92c75f3dba7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:28.535689 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-62f41112-0c09-4463-b71d-92c75f3dba7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:28.536242 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-62f41112-0c09-4463-b71d-92c75f3dba7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:28.537447 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-62f41112-0c09-4463-b71d-92c75f3dba7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:28.538196 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-62f41112-0c09-4463-b71d-92c75f3dba7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:28.538627 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-62f41112-0c09-4463-b71d-92c75f3dba7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:28.694268 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-62f41112-0c09-4463-b71d-92c75f3dba7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:28.703514 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-62f41112-0c09-4463-b71d-92c75f3dba7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:28.705065 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-62f41112-0c09-4463-b71d-92c75f3dba7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:28.706441 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-62f41112-0c09-4463-b71d-92c75f3dba7b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.187110 Sep 13 01:19:28.707071 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 59/132] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:28 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:28.800647 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c25fe302-42f8-44d5-9d45-b964d6387cd7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:28.802503 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c25fe302-42f8-44d5-9d45-b964d6387cd7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:28.814681 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c25fe302-42f8-44d5-9d45-b964d6387cd7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:28.816954 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c25fe302-42f8-44d5-9d45-b964d6387cd7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:28.818232 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c25fe302-42f8-44d5-9d45-b964d6387cd7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:28.820775 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c25fe302-42f8-44d5-9d45-b964d6387cd7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:28.823573 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c25fe302-42f8-44d5-9d45-b964d6387cd7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:28.824158 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c25fe302-42f8-44d5-9d45-b964d6387cd7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:29.023091 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c25fe302-42f8-44d5-9d45-b964d6387cd7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:29.033210 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c25fe302-42f8-44d5-9d45-b964d6387cd7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.239583 Sep 13 01:19:29.034419 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 74/133] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:28 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:29.172329 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3e9815c1-cee2-443d-98b7-2a4e9c85391a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:29.172942 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3e9815c1-cee2-443d-98b7-2a4e9c85391a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:29.179469 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e9815c1-cee2-443d-98b7-2a4e9c85391a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:29.179964 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e9815c1-cee2-443d-98b7-2a4e9c85391a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:29.180393 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e9815c1-cee2-443d-98b7-2a4e9c85391a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:29.181080 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e9815c1-cee2-443d-98b7-2a4e9c85391a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:29.181526 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e9815c1-cee2-443d-98b7-2a4e9c85391a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:29.182095 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e9815c1-cee2-443d-98b7-2a4e9c85391a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:29.334467 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3e9815c1-cee2-443d-98b7-2a4e9c85391a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:29.342101 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3e9815c1-cee2-443d-98b7-2a4e9c85391a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.175055 Sep 13 01:19:29.343029 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 60/134] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:29 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:29.416239 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-d9e68667-daa4-43ab-aa12-5f19d3135582 req-2bab8793-7c54-4139-bce0-e090bea7ff9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a24ff77-efd2-4d53-b120-387e032d8e33", "name": "network-vif-plugged", "status": "completed", "tag": "aa920202-f96d-4a78-9f35-43655e114baf"}, {"server_uuid": "2e628b0a-c70b-4c2b-b98e-339abc492871", "name": "network-vif-plugged", "status": "completed", "tag": "1a2cf032-3cde-45a3-9e82-737d704d0b9f"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:29.432797 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-d9e68667-daa4-43ab-aa12-5f19d3135582 req-2bab8793-7c54-4139-bce0-e090bea7ff9f service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:29.433274 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-d9e68667-daa4-43ab-aa12-5f19d3135582 req-2bab8793-7c54-4139-bce0-e090bea7ff9f service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:29.433727 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-d9e68667-daa4-43ab-aa12-5f19d3135582 req-2bab8793-7c54-4139-bce0-e090bea7ff9f service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:29.451256 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-d9e68667-daa4-43ab-aa12-5f19d3135582 req-2bab8793-7c54-4139-bce0-e090bea7ff9f service nova] Creating event network-vif-plugged:aa920202-f96d-4a78-9f35-43655e114baf for instance 2a24ff77-efd2-4d53-b120-387e032d8e33 on hv-cinder-85694 Sep 13 01:19:29.451852 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-d9e68667-daa4-43ab-aa12-5f19d3135582 req-2bab8793-7c54-4139-bce0-e090bea7ff9f service nova] Creating event network-vif-plugged:1a2cf032-3cde-45a3-9e82-737d704d0b9f for instance 2e628b0a-c70b-4c2b-b98e-339abc492871 on hv-cinder-85694 Sep 13 01:19:29.461925 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-d9e68667-daa4-43ab-aa12-5f19d3135582 req-2bab8793-7c54-4139-bce0-e090bea7ff9f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.047886 Sep 13 01:19:29.463364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 75/135] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:19:29.475181 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-66a01581-a9d1-4e00-97ab-189fd23d2ad3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:29.476202 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-66a01581-a9d1-4e00-97ab-189fd23d2ad3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:29.486049 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-66a01581-a9d1-4e00-97ab-189fd23d2ad3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:29.486781 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-66a01581-a9d1-4e00-97ab-189fd23d2ad3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:29.487590 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-66a01581-a9d1-4e00-97ab-189fd23d2ad3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:29.488576 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-66a01581-a9d1-4e00-97ab-189fd23d2ad3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:29.489161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-66a01581-a9d1-4e00-97ab-189fd23d2ad3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:29.489844 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-66a01581-a9d1-4e00-97ab-189fd23d2ad3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:29.687180 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-66a01581-a9d1-4e00-97ab-189fd23d2ad3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:29.697270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-66a01581-a9d1-4e00-97ab-189fd23d2ad3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.227318 Sep 13 01:19:29.697857 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 61/136] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:29 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:29.733816 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f50c7abf-652e-409e-b242-d1e3245ae3f8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:29.734802 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f50c7abf-652e-409e-b242-d1e3245ae3f8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:29.742817 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f50c7abf-652e-409e-b242-d1e3245ae3f8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:29.743901 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f50c7abf-652e-409e-b242-d1e3245ae3f8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:29.744824 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f50c7abf-652e-409e-b242-d1e3245ae3f8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:29.745800 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f50c7abf-652e-409e-b242-d1e3245ae3f8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:29.746374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f50c7abf-652e-409e-b242-d1e3245ae3f8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:29.747088 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f50c7abf-652e-409e-b242-d1e3245ae3f8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:29.902484 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f50c7abf-652e-409e-b242-d1e3245ae3f8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:29.914595 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f50c7abf-652e-409e-b242-d1e3245ae3f8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:29.916179 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f50c7abf-652e-409e-b242-d1e3245ae3f8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:29.917398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f50c7abf-652e-409e-b242-d1e3245ae3f8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.189894 Sep 13 01:19:29.917953 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 76/137] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:29 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:30.059587 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a303d151-53f5-4900-9f8e-df5ba43b92c9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:30.060636 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a303d151-53f5-4900-9f8e-df5ba43b92c9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:30.077543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a303d151-53f5-4900-9f8e-df5ba43b92c9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:30.078289 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a303d151-53f5-4900-9f8e-df5ba43b92c9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:30.078727 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a303d151-53f5-4900-9f8e-df5ba43b92c9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:30.079469 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a303d151-53f5-4900-9f8e-df5ba43b92c9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:30.080043 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a303d151-53f5-4900-9f8e-df5ba43b92c9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:30.080468 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a303d151-53f5-4900-9f8e-df5ba43b92c9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:30.245830 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a303d151-53f5-4900-9f8e-df5ba43b92c9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:30.257262 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a303d151-53f5-4900-9f8e-df5ba43b92c9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.204231 Sep 13 01:19:30.257841 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 62/138] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:30 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:30.366208 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-489b7e42-41ad-4b5a-8b5b-523f18072e02 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:30.367396 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-489b7e42-41ad-4b5a-8b5b-523f18072e02 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:30.375654 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-489b7e42-41ad-4b5a-8b5b-523f18072e02 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:30.376757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-489b7e42-41ad-4b5a-8b5b-523f18072e02 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:30.377421 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-489b7e42-41ad-4b5a-8b5b-523f18072e02 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:30.378677 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-489b7e42-41ad-4b5a-8b5b-523f18072e02 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:30.379395 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-489b7e42-41ad-4b5a-8b5b-523f18072e02 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:30.380292 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-489b7e42-41ad-4b5a-8b5b-523f18072e02 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:30.573007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-489b7e42-41ad-4b5a-8b5b-523f18072e02 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:30.588306 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-489b7e42-41ad-4b5a-8b5b-523f18072e02 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.224838 Sep 13 01:19:30.589369 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 77/139] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:30 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:30.727512 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-540be497-406a-46fe-babd-bb507e14e4f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:30.734643 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-540be497-406a-46fe-babd-bb507e14e4f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:30.749532 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-540be497-406a-46fe-babd-bb507e14e4f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:30.754717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-540be497-406a-46fe-babd-bb507e14e4f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:30.755714 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-540be497-406a-46fe-babd-bb507e14e4f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:30.757598 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-540be497-406a-46fe-babd-bb507e14e4f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:30.758222 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-540be497-406a-46fe-babd-bb507e14e4f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:30.758918 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-540be497-406a-46fe-babd-bb507e14e4f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:30.942743 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-648f3d9a-af03-45d6-9ea6-e8f0c2523db3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:30.943425 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-648f3d9a-af03-45d6-9ea6-e8f0c2523db3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:30.951936 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-648f3d9a-af03-45d6-9ea6-e8f0c2523db3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:30.952708 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-648f3d9a-af03-45d6-9ea6-e8f0c2523db3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:30.953341 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-648f3d9a-af03-45d6-9ea6-e8f0c2523db3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:30.954266 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-648f3d9a-af03-45d6-9ea6-e8f0c2523db3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:30.954977 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-648f3d9a-af03-45d6-9ea6-e8f0c2523db3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:30.955705 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-648f3d9a-af03-45d6-9ea6-e8f0c2523db3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:30.963953 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-540be497-406a-46fe-babd-bb507e14e4f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:30.968308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=100 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:30.977875 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-540be497-406a-46fe-babd-bb507e14e4f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1322 microversion: 2.1 time: 0.260348 Sep 13 01:19:30.978730 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 63/140] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:30 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:31.142508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-648f3d9a-af03-45d6-9ea6-e8f0c2523db3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:31.152265 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-648f3d9a-af03-45d6-9ea6-e8f0c2523db3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:31.153984 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-648f3d9a-af03-45d6-9ea6-e8f0c2523db3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:31.155789 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-648f3d9a-af03-45d6-9ea6-e8f0c2523db3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.217182 Sep 13 01:19:31.156626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 78/141] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:30 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:31.284369 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9ae4b196-a3ac-4b65-b723-453b7d741bea tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:31.285473 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9ae4b196-a3ac-4b65-b723-453b7d741bea tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:31.292683 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ae4b196-a3ac-4b65-b723-453b7d741bea tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:31.293415 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ae4b196-a3ac-4b65-b723-453b7d741bea tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:31.294105 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ae4b196-a3ac-4b65-b723-453b7d741bea tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:31.295380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ae4b196-a3ac-4b65-b723-453b7d741bea tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:31.296158 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ae4b196-a3ac-4b65-b723-453b7d741bea tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:31.296739 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ae4b196-a3ac-4b65-b723-453b7d741bea tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:31.477350 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-33fdb9b6-9655-4bd8-be6b-2fd9e870595b req-30790ea6-c69c-42ad-bd83-d903f8cf2eaf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85de1ecb-9d12-49d4-b0cd-4631e36357d3", "name": "network-vif-plugged", "status": "completed", "tag": "fd07ce18-daad-47e8-8e34-3a96d4e32e60"}, {"server_uuid": "1677b90a-17f0-496f-8fce-ac573509c1ac", "name": "network-vif-plugged", "status": "completed", "tag": "88cd16db-1d4f-46f0-9069-3f6713e3efbd"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:31.483200 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:31.501540 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-9ae4b196-a3ac-4b65-b723-453b7d741bea tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:31.510594 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-33fdb9b6-9655-4bd8-be6b-2fd9e870595b req-30790ea6-c69c-42ad-bd83-d903f8cf2eaf service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:31.511242 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-33fdb9b6-9655-4bd8-be6b-2fd9e870595b req-30790ea6-c69c-42ad-bd83-d903f8cf2eaf service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:31.512334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9ae4b196-a3ac-4b65-b723-453b7d741bea tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.231097 Sep 13 01:19:31.513257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-33fdb9b6-9655-4bd8-be6b-2fd9e870595b req-30790ea6-c69c-42ad-bd83-d903f8cf2eaf service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:31.514793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 64/142] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:31 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:31.533741 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-33fdb9b6-9655-4bd8-be6b-2fd9e870595b req-30790ea6-c69c-42ad-bd83-d903f8cf2eaf service nova] Creating event network-vif-plugged:fd07ce18-daad-47e8-8e34-3a96d4e32e60 for instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 on hv-cinder-85694 Sep 13 01:19:31.534243 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-33fdb9b6-9655-4bd8-be6b-2fd9e870595b req-30790ea6-c69c-42ad-bd83-d903f8cf2eaf service nova] Creating event network-vif-plugged:88cd16db-1d4f-46f0-9069-3f6713e3efbd for instance 1677b90a-17f0-496f-8fce-ac573509c1ac on hv-cinder-85694 Sep 13 01:19:31.540978 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-33fdb9b6-9655-4bd8-be6b-2fd9e870595b req-30790ea6-c69c-42ad-bd83-d903f8cf2eaf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067689 Sep 13 01:19:31.541994 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 79/143] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:19:31.612810 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ca3999f9-f88b-4005-99f7-0468484f2dd0 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:31.613531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ca3999f9-f88b-4005-99f7-0468484f2dd0 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:31.625661 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ca3999f9-f88b-4005-99f7-0468484f2dd0 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:31.626359 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ca3999f9-f88b-4005-99f7-0468484f2dd0 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:31.626602 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ca3999f9-f88b-4005-99f7-0468484f2dd0 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:31.627353 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ca3999f9-f88b-4005-99f7-0468484f2dd0 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:31.627895 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ca3999f9-f88b-4005-99f7-0468484f2dd0 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:31.628362 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ca3999f9-f88b-4005-99f7-0468484f2dd0 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:31.882392 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ca3999f9-f88b-4005-99f7-0468484f2dd0 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:31.891029 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ca3999f9-f88b-4005-99f7-0468484f2dd0 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1314 microversion: 2.1 time: 0.282117 Sep 13 01:19:31.892093 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 65/144] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:31 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:32.006561 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-df0cf667-9a4b-4eae-a805-2865cfc3e17d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:32.007528 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-df0cf667-9a4b-4eae-a805-2865cfc3e17d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:32.014841 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df0cf667-9a4b-4eae-a805-2865cfc3e17d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:32.015664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df0cf667-9a4b-4eae-a805-2865cfc3e17d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:32.016316 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df0cf667-9a4b-4eae-a805-2865cfc3e17d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:32.017245 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df0cf667-9a4b-4eae-a805-2865cfc3e17d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:32.017876 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df0cf667-9a4b-4eae-a805-2865cfc3e17d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:32.018710 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df0cf667-9a4b-4eae-a805-2865cfc3e17d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:32.182328 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f9808f96-1305-4e91-8780-d7975e2f5015 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:32.183106 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-f9808f96-1305-4e91-8780-d7975e2f5015 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:32.191551 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f9808f96-1305-4e91-8780-d7975e2f5015 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:32.195921 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f9808f96-1305-4e91-8780-d7975e2f5015 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:32.196470 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f9808f96-1305-4e91-8780-d7975e2f5015 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:32.198109 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f9808f96-1305-4e91-8780-d7975e2f5015 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:32.198711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f9808f96-1305-4e91-8780-d7975e2f5015 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:32.200620 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f9808f96-1305-4e91-8780-d7975e2f5015 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:32.306537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-df0cf667-9a4b-4eae-a805-2865cfc3e17d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:32.316120 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-df0cf667-9a4b-4eae-a805-2865cfc3e17d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1514 microversion: 2.1 time: 0.314473 Sep 13 01:19:32.317935 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 80/145] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:32 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:32.340687 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2d2f3f81-bbef-47ca-a352-802424b51443 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:32.343201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2d2f3f81-bbef-47ca-a352-802424b51443 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:32.350385 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d2f3f81-bbef-47ca-a352-802424b51443 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:32.351175 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d2f3f81-bbef-47ca-a352-802424b51443 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:32.351760 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d2f3f81-bbef-47ca-a352-802424b51443 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:32.352646 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d2f3f81-bbef-47ca-a352-802424b51443 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:32.353242 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d2f3f81-bbef-47ca-a352-802424b51443 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:32.354389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d2f3f81-bbef-47ca-a352-802424b51443 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:32.425600 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-2d2f3f81-bbef-47ca-a352-802424b51443 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lazy-loading 'flavor' on Instance uuid 2e628b0a-c70b-4c2b-b98e-339abc492871 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:19:32.430675 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f9808f96-1305-4e91-8780-d7975e2f5015 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:32.440445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f9808f96-1305-4e91-8780-d7975e2f5015 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:32.442071 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f9808f96-1305-4e91-8780-d7975e2f5015 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:32.443671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f9808f96-1305-4e91-8780-d7975e2f5015 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.265719 Sep 13 01:19:32.461664 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 66/146] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:32 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:32.544883 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a6dc3e72-1e4f-4652-8b6f-fbf7737e767b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:32.547124 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a6dc3e72-1e4f-4652-8b6f-fbf7737e767b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:32.555132 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a6dc3e72-1e4f-4652-8b6f-fbf7737e767b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:32.555765 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a6dc3e72-1e4f-4652-8b6f-fbf7737e767b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:32.556297 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2d2f3f81-bbef-47ca-a352-802424b51443 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "POST /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871/action" status: 200 len: 32 microversion: 2.1 time: 0.220015 Sep 13 01:19:32.556415 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a6dc3e72-1e4f-4652-8b6f-fbf7737e767b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:32.557183 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 81/147] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:19:32 2022] POST /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871/action => generated 32 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 01:19:32.562999 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a6dc3e72-1e4f-4652-8b6f-fbf7737e767b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:32.563815 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a6dc3e72-1e4f-4652-8b6f-fbf7737e767b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:32.564445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a6dc3e72-1e4f-4652-8b6f-fbf7737e767b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:32.567593 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5ecfdfa4-9dee-4d33-84b3-70b788fb08a1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:32.568361 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5ecfdfa4-9dee-4d33-84b3-70b788fb08a1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:32.574988 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ecfdfa4-9dee-4d33-84b3-70b788fb08a1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:32.575552 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ecfdfa4-9dee-4d33-84b3-70b788fb08a1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:32.576123 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ecfdfa4-9dee-4d33-84b3-70b788fb08a1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:32.577007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ecfdfa4-9dee-4d33-84b3-70b788fb08a1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:32.577617 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ecfdfa4-9dee-4d33-84b3-70b788fb08a1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:32.578184 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ecfdfa4-9dee-4d33-84b3-70b788fb08a1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:32.743457 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5ecfdfa4-9dee-4d33-84b3-70b788fb08a1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:32.751505 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5ecfdfa4-9dee-4d33-84b3-70b788fb08a1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.188298 Sep 13 01:19:32.752205 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a6dc3e72-1e4f-4652-8b6f-fbf7737e767b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:32.753263 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 82/148] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:32 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:32.761238 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a6dc3e72-1e4f-4652-8b6f-fbf7737e767b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.227820 Sep 13 01:19:32.761951 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 67/149] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:32 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:32.916338 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fe4f0988-b6ac-4ba5-81ff-81d72a0535ff tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:32.917033 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fe4f0988-b6ac-4ba5-81ff-81d72a0535ff tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:32.924086 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe4f0988-b6ac-4ba5-81ff-81d72a0535ff tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:32.924509 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe4f0988-b6ac-4ba5-81ff-81d72a0535ff tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:32.924948 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe4f0988-b6ac-4ba5-81ff-81d72a0535ff tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:32.925648 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe4f0988-b6ac-4ba5-81ff-81d72a0535ff tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:32.926100 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe4f0988-b6ac-4ba5-81ff-81d72a0535ff tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:32.926523 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe4f0988-b6ac-4ba5-81ff-81d72a0535ff tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:33.078605 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fe4f0988-b6ac-4ba5-81ff-81d72a0535ff tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:33.087274 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fe4f0988-b6ac-4ba5-81ff-81d72a0535ff tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1502 microversion: 2.1 time: 0.175148 Sep 13 01:19:33.088009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 83/150] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:32 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1502 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:33.470798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-468acb88-e670-4011-a2b4-65695f12f475 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:33.472233 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-468acb88-e670-4011-a2b4-65695f12f475 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:33.480641 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-468acb88-e670-4011-a2b4-65695f12f475 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:33.481932 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-468acb88-e670-4011-a2b4-65695f12f475 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:33.482761 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-468acb88-e670-4011-a2b4-65695f12f475 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:33.483676 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-468acb88-e670-4011-a2b4-65695f12f475 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:33.484210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-468acb88-e670-4011-a2b4-65695f12f475 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:33.484772 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-468acb88-e670-4011-a2b4-65695f12f475 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:33.682952 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-468acb88-e670-4011-a2b4-65695f12f475 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:33.693067 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-468acb88-e670-4011-a2b4-65695f12f475 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:33.695106 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-468acb88-e670-4011-a2b4-65695f12f475 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:33.696769 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-468acb88-e670-4011-a2b4-65695f12f475 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.231372 Sep 13 01:19:33.697515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 68/151] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:33 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:33.775244 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-75cbedf6-37f4-47cd-bddd-97f211022d35 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:33.775889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-75cbedf6-37f4-47cd-bddd-97f211022d35 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:33.783753 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75cbedf6-37f4-47cd-bddd-97f211022d35 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:33.784266 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f0290a12-3e22-42e0-bcaf-efa0696d3bd8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:33.784704 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75cbedf6-37f4-47cd-bddd-97f211022d35 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:33.785017 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-f0290a12-3e22-42e0-bcaf-efa0696d3bd8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:33.785439 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75cbedf6-37f4-47cd-bddd-97f211022d35 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:33.786296 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75cbedf6-37f4-47cd-bddd-97f211022d35 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:33.786911 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75cbedf6-37f4-47cd-bddd-97f211022d35 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:33.787477 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-75cbedf6-37f4-47cd-bddd-97f211022d35 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:33.791782 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f0290a12-3e22-42e0-bcaf-efa0696d3bd8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:33.792307 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f0290a12-3e22-42e0-bcaf-efa0696d3bd8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:33.792851 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f0290a12-3e22-42e0-bcaf-efa0696d3bd8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:33.793738 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f0290a12-3e22-42e0-bcaf-efa0696d3bd8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:33.794236 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f0290a12-3e22-42e0-bcaf-efa0696d3bd8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:33.795224 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f0290a12-3e22-42e0-bcaf-efa0696d3bd8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:33.983899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f0290a12-3e22-42e0-bcaf-efa0696d3bd8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:33.993019 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f0290a12-3e22-42e0-bcaf-efa0696d3bd8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.213766 Sep 13 01:19:33.993723 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 69/152] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:33 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:34.005797 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-75cbedf6-37f4-47cd-bddd-97f211022d35 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:34.020002 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-75cbedf6-37f4-47cd-bddd-97f211022d35 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.248914 Sep 13 01:19:34.020572 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 84/153] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:33 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:34.722428 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-aa9d8ab3-7d7b-4511-9886-940ca3722fb6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:34.723140 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-aa9d8ab3-7d7b-4511-9886-940ca3722fb6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:34.729159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aa9d8ab3-7d7b-4511-9886-940ca3722fb6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:34.729685 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aa9d8ab3-7d7b-4511-9886-940ca3722fb6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:34.730361 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aa9d8ab3-7d7b-4511-9886-940ca3722fb6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:34.731096 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aa9d8ab3-7d7b-4511-9886-940ca3722fb6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:34.731542 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aa9d8ab3-7d7b-4511-9886-940ca3722fb6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:34.731996 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aa9d8ab3-7d7b-4511-9886-940ca3722fb6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:34.869804 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-aa9d8ab3-7d7b-4511-9886-940ca3722fb6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:34.878609 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-aa9d8ab3-7d7b-4511-9886-940ca3722fb6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:34.880116 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-aa9d8ab3-7d7b-4511-9886-940ca3722fb6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:34.881230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-aa9d8ab3-7d7b-4511-9886-940ca3722fb6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.162781 Sep 13 01:19:34.881791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 70/154] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:34 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:35.024356 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a0b5549e-3358-49d3-a361-4ca18be58664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:35.025018 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a0b5549e-3358-49d3-a361-4ca18be58664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:35.031264 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0b5549e-3358-49d3-a361-4ca18be58664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:35.031750 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0b5549e-3358-49d3-a361-4ca18be58664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:35.032192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0b5549e-3358-49d3-a361-4ca18be58664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:35.032890 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0b5549e-3358-49d3-a361-4ca18be58664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:35.033346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0b5549e-3358-49d3-a361-4ca18be58664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:35.033772 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a0b5549e-3358-49d3-a361-4ca18be58664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:35.047506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ed12d7a6-aaef-4990-88fc-8474d5a221d2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:35.048349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ed12d7a6-aaef-4990-88fc-8474d5a221d2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:35.059649 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed12d7a6-aaef-4990-88fc-8474d5a221d2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:35.060686 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed12d7a6-aaef-4990-88fc-8474d5a221d2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:35.061538 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed12d7a6-aaef-4990-88fc-8474d5a221d2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:35.071576 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed12d7a6-aaef-4990-88fc-8474d5a221d2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:35.072135 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed12d7a6-aaef-4990-88fc-8474d5a221d2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:35.074998 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed12d7a6-aaef-4990-88fc-8474d5a221d2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:35.282476 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a0b5549e-3358-49d3-a361-4ca18be58664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:35.291702 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a0b5549e-3358-49d3-a361-4ca18be58664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.271069 Sep 13 01:19:35.292422 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 85/155] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:35 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:35.489271 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ed12d7a6-aaef-4990-88fc-8474d5a221d2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:35.498007 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ed12d7a6-aaef-4990-88fc-8474d5a221d2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.455958 Sep 13 01:19:35.498832 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 71/156] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:35 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:35.687464 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ba945a8f-98d4-4525-bf42-8a07a152f9f6 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b1d0542-c242-43c8-8d11-ededa1b2d60a"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:35.690521 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ba945a8f-98d4-4525-bf42-8a07a152f9f6 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:35.697809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ba945a8f-98d4-4525-bf42-8a07a152f9f6 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:35.698581 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ba945a8f-98d4-4525-bf42-8a07a152f9f6 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:35.699137 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ba945a8f-98d4-4525-bf42-8a07a152f9f6 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:35.699739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ba945a8f-98d4-4525-bf42-8a07a152f9f6 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:35.700576 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ba945a8f-98d4-4525-bf42-8a07a152f9f6 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:35.701321 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ba945a8f-98d4-4525-bf42-8a07a152f9f6 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:35.721446 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:35.892894 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1930991384", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452"}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:35.957436 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.network.neutron [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] validate_networks() for None {{(pid=120412) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:19:36.404626 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Flavor limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:19:36.405043 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Image limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:19:36.405510 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Flavor pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:19:36.405935 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Image pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:19:36.406348 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:19:36.415610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:36.416116 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:36.416544 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:36.417443 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:36.417921 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:36.418337 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:36.436436 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Getting quotas for project b0422bd9612349b8a0cbcae6f1a588b7. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:19:36.440378 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Getting quotas for user 93409ebeeab6464abf34f26ebd37a2a9 and project b0422bd9612349b8a0cbcae6f1a588b7. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:19:36.451648 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Going to run 1 instances... {{(pid=120412) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:19:36.453928 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120412) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:19:36.500671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3f6b4ef0-9884-403a-8270-1d2d15e1d2f8 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612208 Sep 13 01:19:36.507044 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 72/157] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:19:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 619 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 01:19:36.514449 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ab375aae-c469-4fef-9c44-a50c7d5e57fa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:36.515236 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ab375aae-c469-4fef-9c44-a50c7d5e57fa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:36.525359 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ab375aae-c469-4fef-9c44-a50c7d5e57fa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:36.526081 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ab375aae-c469-4fef-9c44-a50c7d5e57fa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:36.526661 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ab375aae-c469-4fef-9c44-a50c7d5e57fa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:36.527605 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ab375aae-c469-4fef-9c44-a50c7d5e57fa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:36.528483 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ab375aae-c469-4fef-9c44-a50c7d5e57fa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:36.529518 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ab375aae-c469-4fef-9c44-a50c7d5e57fa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:36.670457 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ab375aae-c469-4fef-9c44-a50c7d5e57fa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:36.679063 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ab375aae-c469-4fef-9c44-a50c7d5e57fa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:36.680732 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ab375aae-c469-4fef-9c44-a50c7d5e57fa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:36.682025 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ab375aae-c469-4fef-9c44-a50c7d5e57fa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1406 microversion: 2.20 time: 0.173030 Sep 13 01:19:36.682802 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 73/158] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:36 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:19:36.695032 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a13038cc-d7e7-42e4-9d7d-99c534ca89c7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:36.697832 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a13038cc-d7e7-42e4-9d7d-99c534ca89c7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:36.703204 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a13038cc-d7e7-42e4-9d7d-99c534ca89c7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:36.703902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a13038cc-d7e7-42e4-9d7d-99c534ca89c7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:36.704420 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a13038cc-d7e7-42e4-9d7d-99c534ca89c7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:36.705205 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a13038cc-d7e7-42e4-9d7d-99c534ca89c7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:36.705755 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a13038cc-d7e7-42e4-9d7d-99c534ca89c7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:36.706254 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a13038cc-d7e7-42e4-9d7d-99c534ca89c7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:36.899389 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a13038cc-d7e7-42e4-9d7d-99c534ca89c7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:36.910781 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a13038cc-d7e7-42e4-9d7d-99c534ca89c7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1361 microversion: 2.1 time: 0.221770 Sep 13 01:19:36.911743 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 74/159] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:36 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1361 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:36.935763 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-56d73a5d-3ec7-413e-aa08-7a6dbaa501fb tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:36.936663 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-56d73a5d-3ec7-413e-aa08-7a6dbaa501fb tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:36.946158 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:37.015963 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-56d73a5d-3ec7-413e-aa08-7a6dbaa501fb tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:37.032370 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-56d73a5d-3ec7-413e-aa08-7a6dbaa501fb tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1215 microversion: 2.1 time: 0.116005 Sep 13 01:19:37.042909 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 75/160] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:36 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1215 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:37.042909 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-20b530d3-f843-4979-92f1-fa35609afe5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:37.042909 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-20b530d3-f843-4979-92f1-fa35609afe5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:37.048379 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-20b530d3-f843-4979-92f1-fa35609afe5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:37.048889 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-20b530d3-f843-4979-92f1-fa35609afe5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:37.049406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-20b530d3-f843-4979-92f1-fa35609afe5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:37.054489 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-20b530d3-f843-4979-92f1-fa35609afe5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:37.055006 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-20b530d3-f843-4979-92f1-fa35609afe5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:37.055601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-20b530d3-f843-4979-92f1-fa35609afe5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:37.120943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ba945a8f-98d4-4525-bf42-8a07a152f9f6 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "POST /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.438431 Sep 13 01:19:37.122099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 86/161] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:19:35 2022] POST /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33/os-volume_attachments => generated 194 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:19:37.260918 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-20b530d3-f843-4979-92f1-fa35609afe5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:37.268978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-20b530d3-f843-4979-92f1-fa35609afe5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.234780 Sep 13 01:19:37.271415 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 76/162] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:37 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:37.708557 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-29e85d43-1a34-46a1-8712-f5b3c070a0cb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:37.709279 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-29e85d43-1a34-46a1-8712-f5b3c070a0cb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:37.715914 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-29e85d43-1a34-46a1-8712-f5b3c070a0cb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:37.716915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-29e85d43-1a34-46a1-8712-f5b3c070a0cb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:37.717431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-29e85d43-1a34-46a1-8712-f5b3c070a0cb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:37.718346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-29e85d43-1a34-46a1-8712-f5b3c070a0cb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:37.718803 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-29e85d43-1a34-46a1-8712-f5b3c070a0cb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:37.719254 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-29e85d43-1a34-46a1-8712-f5b3c070a0cb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:37.853706 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-29e85d43-1a34-46a1-8712-f5b3c070a0cb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:37.862262 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-29e85d43-1a34-46a1-8712-f5b3c070a0cb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:37.863734 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-29e85d43-1a34-46a1-8712-f5b3c070a0cb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:37.864885 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-29e85d43-1a34-46a1-8712-f5b3c070a0cb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1597 microversion: 2.20 time: 0.161216 Sep 13 01:19:37.865433 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 87/163] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:19:37 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1597 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:19:37.889029 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-cbd43ed3-8e00-4213-ad61-6653f3dd58bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:37.889520 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-cbd43ed3-8e00-4213-ad61-6653f3dd58bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:37.895487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cbd43ed3-8e00-4213-ad61-6653f3dd58bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:37.895962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cbd43ed3-8e00-4213-ad61-6653f3dd58bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:37.896388 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cbd43ed3-8e00-4213-ad61-6653f3dd58bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:37.897069 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cbd43ed3-8e00-4213-ad61-6653f3dd58bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:37.897524 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cbd43ed3-8e00-4213-ad61-6653f3dd58bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:37.897941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cbd43ed3-8e00-4213-ad61-6653f3dd58bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:37.935057 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2d1be841-0871-4bf7-adf6-351e42a843a7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:37.935695 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2d1be841-0871-4bf7-adf6-351e42a843a7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:37.941744 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d1be841-0871-4bf7-adf6-351e42a843a7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:37.942218 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d1be841-0871-4bf7-adf6-351e42a843a7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:37.942646 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d1be841-0871-4bf7-adf6-351e42a843a7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:37.943364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d1be841-0871-4bf7-adf6-351e42a843a7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:37.943812 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d1be841-0871-4bf7-adf6-351e42a843a7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:37.944229 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d1be841-0871-4bf7-adf6-351e42a843a7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:38.014813 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-cbd43ed3-8e00-4213-ad61-6653f3dd58bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.129515 Sep 13 01:19:38.015448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 77/164] 10.222.0.15 () {60 vars in 1316 bytes} [Tue Sep 13 01:19:37 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:19:38.059223 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-90e4229f-df11-48e7-8159-1ffe848a577b tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:38.059936 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-90e4229f-df11-48e7-8159-1ffe848a577b tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:38.074024 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-90e4229f-df11-48e7-8159-1ffe848a577b tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:38.074024 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-90e4229f-df11-48e7-8159-1ffe848a577b tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:38.074024 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-90e4229f-df11-48e7-8159-1ffe848a577b tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:38.074024 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-90e4229f-df11-48e7-8159-1ffe848a577b tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:38.074652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-90e4229f-df11-48e7-8159-1ffe848a577b tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:38.083972 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-90e4229f-df11-48e7-8159-1ffe848a577b tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:38.202911 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2d1be841-0871-4bf7-adf6-351e42a843a7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:38.217190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2d1be841-0871-4bf7-adf6-351e42a843a7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1546 microversion: 2.1 time: 0.285295 Sep 13 01:19:38.219163 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 88/165] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:37 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1546 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:38.243186 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-25ba632d-36b8-4503-830b-e134a66ca79b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:38.243940 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-25ba632d-36b8-4503-830b-e134a66ca79b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:38.258126 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25ba632d-36b8-4503-830b-e134a66ca79b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:38.258629 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25ba632d-36b8-4503-830b-e134a66ca79b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:38.260032 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25ba632d-36b8-4503-830b-e134a66ca79b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:38.260960 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25ba632d-36b8-4503-830b-e134a66ca79b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:38.261571 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25ba632d-36b8-4503-830b-e134a66ca79b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:38.262160 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25ba632d-36b8-4503-830b-e134a66ca79b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:38.299700 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-90e4229f-df11-48e7-8159-1ffe848a577b tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:38.322573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-90e4229f-df11-48e7-8159-1ffe848a577b tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1211 microversion: 2.1 time: 0.265882 Sep 13 01:19:38.325297 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 78/166] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:38 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1211 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:38.337432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-fd3c2f33-8164-4657-b912-a054c33ac52f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:38.340013 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-fd3c2f33-8164-4657-b912-a054c33ac52f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:38.361516 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd3c2f33-8164-4657-b912-a054c33ac52f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:38.362024 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd3c2f33-8164-4657-b912-a054c33ac52f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:38.365257 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd3c2f33-8164-4657-b912-a054c33ac52f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:38.366038 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd3c2f33-8164-4657-b912-a054c33ac52f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:38.366519 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd3c2f33-8164-4657-b912-a054c33ac52f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:38.366989 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd3c2f33-8164-4657-b912-a054c33ac52f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:38.474880 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-25ba632d-36b8-4503-830b-e134a66ca79b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.227462 Sep 13 01:19:38.474880 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 89/167] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 01:19:38 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/os-interface => generated 284 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:19:38.650592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-fd3c2f33-8164-4657-b912-a054c33ac52f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:38.661108 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-fd3c2f33-8164-4657-b912-a054c33ac52f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.331333 Sep 13 01:19:38.678389 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 79/168] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:38 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:39.351717 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6c406be7-32a3-47f2-939f-985d9d00ec3f tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:39.352372 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6c406be7-32a3-47f2-939f-985d9d00ec3f tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:39.362169 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c406be7-32a3-47f2-939f-985d9d00ec3f tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:39.362729 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c406be7-32a3-47f2-939f-985d9d00ec3f tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:39.382164 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c406be7-32a3-47f2-939f-985d9d00ec3f tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:39.384710 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c406be7-32a3-47f2-939f-985d9d00ec3f tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:39.387703 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c406be7-32a3-47f2-939f-985d9d00ec3f tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:39.390542 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c406be7-32a3-47f2-939f-985d9d00ec3f tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:39.527289 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6c406be7-32a3-47f2-939f-985d9d00ec3f tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:39.537009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6c406be7-32a3-47f2-939f-985d9d00ec3f tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1275 microversion: 2.1 time: 0.189759 Sep 13 01:19:39.551306 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 90/169] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:39 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1275 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:39.694577 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-783f5caa-74e8-4cf6-bae4-628999b57051 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:39.695237 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-783f5caa-74e8-4cf6-bae4-628999b57051 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:39.707823 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-783f5caa-74e8-4cf6-bae4-628999b57051 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:39.708183 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-783f5caa-74e8-4cf6-bae4-628999b57051 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:39.708617 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-783f5caa-74e8-4cf6-bae4-628999b57051 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:39.719018 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-783f5caa-74e8-4cf6-bae4-628999b57051 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:39.719513 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-783f5caa-74e8-4cf6-bae4-628999b57051 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:39.721074 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-783f5caa-74e8-4cf6-bae4-628999b57051 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:40.072227 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-783f5caa-74e8-4cf6-bae4-628999b57051 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:40.080442 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-783f5caa-74e8-4cf6-bae4-628999b57051 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.389575 Sep 13 01:19:40.091959 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 80/170] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:39 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:40.560364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-71a83ad3-a397-4510-b614-b3ecd212a6d4 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:40.561221 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-71a83ad3-a397-4510-b614-b3ecd212a6d4 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:40.568751 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-71a83ad3-a397-4510-b614-b3ecd212a6d4 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:40.569251 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-71a83ad3-a397-4510-b614-b3ecd212a6d4 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:40.570107 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-71a83ad3-a397-4510-b614-b3ecd212a6d4 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:40.570838 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-71a83ad3-a397-4510-b614-b3ecd212a6d4 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:40.571358 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-71a83ad3-a397-4510-b614-b3ecd212a6d4 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:40.572002 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-71a83ad3-a397-4510-b614-b3ecd212a6d4 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:40.635668 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-eb04f62e-4925-43ba-87cb-3932477b5597 req-aaf3445c-9b40-4973-afd9-57b91f5cce95 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1677b90a-17f0-496f-8fce-ac573509c1ac", "tag": "88cd16db-1d4f-46f0-9069-3f6713e3efbd"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:40.660131 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-eb04f62e-4925-43ba-87cb-3932477b5597 req-aaf3445c-9b40-4973-afd9-57b91f5cce95 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:40.661647 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-eb04f62e-4925-43ba-87cb-3932477b5597 req-aaf3445c-9b40-4973-afd9-57b91f5cce95 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:40.664192 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-eb04f62e-4925-43ba-87cb-3932477b5597 req-aaf3445c-9b40-4973-afd9-57b91f5cce95 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:40.671470 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-71a83ad3-a397-4510-b614-b3ecd212a6d4 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:40.688244 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-71a83ad3-a397-4510-b614-b3ecd212a6d4 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1273 microversion: 2.1 time: 0.131911 Sep 13 01:19:40.720248 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 91/171] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:40 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1273 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:40.750881 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-eb04f62e-4925-43ba-87cb-3932477b5597 req-aaf3445c-9b40-4973-afd9-57b91f5cce95 service nova] Creating event network-changed:88cd16db-1d4f-46f0-9069-3f6713e3efbd for instance 1677b90a-17f0-496f-8fce-ac573509c1ac on hv-cinder-85694 Sep 13 01:19:40.773624 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-b720b4ea-ea6e-44d5-8aa3-d56f3e7b475c req-de2fc07d-1c9b-4a66-93c7-6fa7a141471d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "85de1ecb-9d12-49d4-b0cd-4631e36357d3", "tag": "fd07ce18-daad-47e8-8e34-3a96d4e32e60"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:40.791663 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-eb04f62e-4925-43ba-87cb-3932477b5597 req-aaf3445c-9b40-4973-afd9-57b91f5cce95 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.157815 Sep 13 01:19:40.793727 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 81/172] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:19:40.799317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-b720b4ea-ea6e-44d5-8aa3-d56f3e7b475c req-de2fc07d-1c9b-4a66-93c7-6fa7a141471d service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:40.808263 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-b720b4ea-ea6e-44d5-8aa3-d56f3e7b475c req-de2fc07d-1c9b-4a66-93c7-6fa7a141471d service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:40.812638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-b720b4ea-ea6e-44d5-8aa3-d56f3e7b475c req-de2fc07d-1c9b-4a66-93c7-6fa7a141471d service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:40.870015 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-b720b4ea-ea6e-44d5-8aa3-d56f3e7b475c req-de2fc07d-1c9b-4a66-93c7-6fa7a141471d service nova] Creating event network-changed:fd07ce18-daad-47e8-8e34-3a96d4e32e60 for instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 on hv-cinder-85694 Sep 13 01:19:40.885032 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-b720b4ea-ea6e-44d5-8aa3-d56f3e7b475c req-de2fc07d-1c9b-4a66-93c7-6fa7a141471d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.113681 Sep 13 01:19:40.885655 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 92/173] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:19:41.117115 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1fc44c19-8970-4717-bd23-3cb07bc9bf5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:41.117946 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1fc44c19-8970-4717-bd23-3cb07bc9bf5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:41.132058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1fc44c19-8970-4717-bd23-3cb07bc9bf5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:41.135460 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1fc44c19-8970-4717-bd23-3cb07bc9bf5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:41.136645 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1fc44c19-8970-4717-bd23-3cb07bc9bf5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:41.137650 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1fc44c19-8970-4717-bd23-3cb07bc9bf5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:41.140199 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1fc44c19-8970-4717-bd23-3cb07bc9bf5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:41.141432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1fc44c19-8970-4717-bd23-3cb07bc9bf5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:41.749779 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bd583dd0-bea9-4be3-82d6-f75bdb612cd3 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:41.750693 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bd583dd0-bea9-4be3-82d6-f75bdb612cd3 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:41.770213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bd583dd0-bea9-4be3-82d6-f75bdb612cd3 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:41.774457 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bd583dd0-bea9-4be3-82d6-f75bdb612cd3 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:41.775059 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bd583dd0-bea9-4be3-82d6-f75bdb612cd3 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:41.776001 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bd583dd0-bea9-4be3-82d6-f75bdb612cd3 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:41.776703 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bd583dd0-bea9-4be3-82d6-f75bdb612cd3 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:41.777340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bd583dd0-bea9-4be3-82d6-f75bdb612cd3 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:41.989925 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bd583dd0-bea9-4be3-82d6-f75bdb612cd3 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:41.997930 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bd583dd0-bea9-4be3-82d6-f75bdb612cd3 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1273 microversion: 2.1 time: 0.255395 Sep 13 01:19:41.998513 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 93/174] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:41 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1273 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:42.210441 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1fc44c19-8970-4717-bd23-3cb07bc9bf5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:42.220174 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1fc44c19-8970-4717-bd23-3cb07bc9bf5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 1.109489 Sep 13 01:19:42.241831 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 82/175] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:41 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:43.024193 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3609340c-4e74-428a-b653-4c410b02a4e7 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:43.024736 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3609340c-4e74-428a-b653-4c410b02a4e7 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:43.035393 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3609340c-4e74-428a-b653-4c410b02a4e7 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:43.035896 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3609340c-4e74-428a-b653-4c410b02a4e7 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:43.036339 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3609340c-4e74-428a-b653-4c410b02a4e7 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:43.037063 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3609340c-4e74-428a-b653-4c410b02a4e7 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:43.037520 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3609340c-4e74-428a-b653-4c410b02a4e7 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:43.037953 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3609340c-4e74-428a-b653-4c410b02a4e7 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:43.244869 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c6a6e6b3-3681-4639-9023-90127a06ea89 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:43.245486 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c6a6e6b3-3681-4639-9023-90127a06ea89 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:43.260400 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c6a6e6b3-3681-4639-9023-90127a06ea89 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:43.261074 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c6a6e6b3-3681-4639-9023-90127a06ea89 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:43.261585 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c6a6e6b3-3681-4639-9023-90127a06ea89 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:43.263598 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c6a6e6b3-3681-4639-9023-90127a06ea89 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:43.264047 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c6a6e6b3-3681-4639-9023-90127a06ea89 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:43.267373 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c6a6e6b3-3681-4639-9023-90127a06ea89 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:43.272489 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=100 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:43.527405 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3609340c-4e74-428a-b653-4c410b02a4e7 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:43.536860 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3609340c-4e74-428a-b653-4c410b02a4e7 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1315 microversion: 2.1 time: 0.516677 Sep 13 01:19:43.542587 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 94/176] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:43 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1315 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:43.938814 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c6a6e6b3-3681-4639-9023-90127a06ea89 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:43.953268 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c6a6e6b3-3681-4639-9023-90127a06ea89 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.712841 Sep 13 01:19:43.953854 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 83/177] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:43 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:44.530000 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-9064f69e-c00d-4cec-99f4-be5b0603ab5f req-c10511d7-9c44-4381-a4f9-c1ec49acc3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a6b3a740-470d-4918-88b1-aa761182fc2a", "tag": "b78fe83e-11a7-4b62-bf91-c14c14bb0a62"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:44.555228 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-9064f69e-c00d-4cec-99f4-be5b0603ab5f req-c10511d7-9c44-4381-a4f9-c1ec49acc3d3 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:44.558320 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-9064f69e-c00d-4cec-99f4-be5b0603ab5f req-c10511d7-9c44-4381-a4f9-c1ec49acc3d3 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:44.565666 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-6cf10712-5544-40c0-9451-bdc4fcc6ef69 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:44.566987 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-6cf10712-5544-40c0-9451-bdc4fcc6ef69 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:44.567988 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-9064f69e-c00d-4cec-99f4-be5b0603ab5f req-c10511d7-9c44-4381-a4f9-c1ec49acc3d3 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:44.575048 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6cf10712-5544-40c0-9451-bdc4fcc6ef69 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:44.578427 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6cf10712-5544-40c0-9451-bdc4fcc6ef69 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:44.579197 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6cf10712-5544-40c0-9451-bdc4fcc6ef69 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:44.580216 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6cf10712-5544-40c0-9451-bdc4fcc6ef69 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:44.582795 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6cf10712-5544-40c0-9451-bdc4fcc6ef69 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:44.584811 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6cf10712-5544-40c0-9451-bdc4fcc6ef69 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:44.594403 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-9064f69e-c00d-4cec-99f4-be5b0603ab5f req-c10511d7-9c44-4381-a4f9-c1ec49acc3d3 service nova] Creating event network-changed:b78fe83e-11a7-4b62-bf91-c14c14bb0a62 for instance a6b3a740-470d-4918-88b1-aa761182fc2a on hv-cinder-85694 Sep 13 01:19:44.607747 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-9064f69e-c00d-4cec-99f4-be5b0603ab5f req-c10511d7-9c44-4381-a4f9-c1ec49acc3d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082841 Sep 13 01:19:44.612708 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 95/178] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:19:44.820731 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6cf10712-5544-40c0-9451-bdc4fcc6ef69 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:44.836733 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-6cf10712-5544-40c0-9451-bdc4fcc6ef69 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1315 microversion: 2.1 time: 0.275876 Sep 13 01:19:44.837338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 84/179] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:44 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:44.996098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4d94f5be-9a34-40cd-a911-875d8550d234 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:44.996821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4d94f5be-9a34-40cd-a911-875d8550d234 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:45.003191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d94f5be-9a34-40cd-a911-875d8550d234 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:45.003675 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d94f5be-9a34-40cd-a911-875d8550d234 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:45.004112 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d94f5be-9a34-40cd-a911-875d8550d234 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:45.004817 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d94f5be-9a34-40cd-a911-875d8550d234 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:45.005271 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d94f5be-9a34-40cd-a911-875d8550d234 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:45.012366 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d94f5be-9a34-40cd-a911-875d8550d234 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:45.312916 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4d94f5be-9a34-40cd-a911-875d8550d234 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:45.321582 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4d94f5be-9a34-40cd-a911-875d8550d234 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.345584 Sep 13 01:19:45.334449 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 96/180] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:44 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:45.859706 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0b9c77b6-673a-4ceb-b5da-58a1a7d1bd7d tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:45.860343 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0b9c77b6-673a-4ceb-b5da-58a1a7d1bd7d tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:45.872851 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b9c77b6-673a-4ceb-b5da-58a1a7d1bd7d tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:45.873364 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b9c77b6-673a-4ceb-b5da-58a1a7d1bd7d tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:45.873812 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b9c77b6-673a-4ceb-b5da-58a1a7d1bd7d tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:45.874542 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b9c77b6-673a-4ceb-b5da-58a1a7d1bd7d tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:45.875057 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b9c77b6-673a-4ceb-b5da-58a1a7d1bd7d tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:45.875491 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b9c77b6-673a-4ceb-b5da-58a1a7d1bd7d tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:46.341082 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0b9c77b6-673a-4ceb-b5da-58a1a7d1bd7d tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:46.345252 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-90b92784-a7bd-49cd-bc77-efefefc5acbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:46.345873 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-90b92784-a7bd-49cd-bc77-efefefc5acbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:46.359195 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90b92784-a7bd-49cd-bc77-efefefc5acbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:46.359195 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90b92784-a7bd-49cd-bc77-efefefc5acbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:46.359195 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90b92784-a7bd-49cd-bc77-efefefc5acbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:46.359195 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90b92784-a7bd-49cd-bc77-efefefc5acbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:46.359577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90b92784-a7bd-49cd-bc77-efefefc5acbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:46.359577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-90b92784-a7bd-49cd-bc77-efefefc5acbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:46.364669 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0b9c77b6-673a-4ceb-b5da-58a1a7d1bd7d tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1315 microversion: 2.1 time: 0.509231 Sep 13 01:19:46.380663 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 85/181] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:45 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1315 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:46.828665 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-90b92784-a7bd-49cd-bc77-efefefc5acbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:46.837788 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-90b92784-a7bd-49cd-bc77-efefefc5acbf tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.496464 Sep 13 01:19:46.842470 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 97/182] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:46 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:47.330394 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-47a32360-4494-432b-9782-77ac30c57e0a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:47.330978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-47a32360-4494-432b-9782-77ac30c57e0a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:47.332816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:47.333532 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=8 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:47.344805 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-47a32360-4494-432b-9782-77ac30c57e0a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:47.345303 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-47a32360-4494-432b-9782-77ac30c57e0a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:47.352610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-47a32360-4494-432b-9782-77ac30c57e0a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:47.353598 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-47a32360-4494-432b-9782-77ac30c57e0a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:47.354235 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-47a32360-4494-432b-9782-77ac30c57e0a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:47.354872 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-47a32360-4494-432b-9782-77ac30c57e0a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:47.389640 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-47a32360-4494-432b-9782-77ac30c57e0a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Going to try to terminate instance {{(pid=120412) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:19:47.397391 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-132c47c1-a02c-44e8-9bd8-d1a3d33d3b81 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:47.397902 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-132c47c1-a02c-44e8-9bd8-d1a3d33d3b81 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:47.411651 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-132c47c1-a02c-44e8-9bd8-d1a3d33d3b81 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:47.413999 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-132c47c1-a02c-44e8-9bd8-d1a3d33d3b81 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:47.414570 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-132c47c1-a02c-44e8-9bd8-d1a3d33d3b81 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:47.421810 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-132c47c1-a02c-44e8-9bd8-d1a3d33d3b81 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:47.422474 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-132c47c1-a02c-44e8-9bd8-d1a3d33d3b81 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:47.424722 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-132c47c1-a02c-44e8-9bd8-d1a3d33d3b81 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:47.622797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-47a32360-4494-432b-9782-77ac30c57e0a tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 204 len: 0 microversion: 2.1 time: 0.293494 Sep 13 01:19:47.625211 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 86/183] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:19:47 2022] DELETE /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:19:47.639753 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-aa1f403e-dff2-41fa-94c2-d3643e1eb608 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:47.640838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-aa1f403e-dff2-41fa-94c2-d3643e1eb608 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:47.652466 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aa1f403e-dff2-41fa-94c2-d3643e1eb608 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:47.654977 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aa1f403e-dff2-41fa-94c2-d3643e1eb608 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:47.658129 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aa1f403e-dff2-41fa-94c2-d3643e1eb608 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:47.659491 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aa1f403e-dff2-41fa-94c2-d3643e1eb608 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:47.659961 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aa1f403e-dff2-41fa-94c2-d3643e1eb608 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:47.660392 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aa1f403e-dff2-41fa-94c2-d3643e1eb608 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:47.868264 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-aa1f403e-dff2-41fa-94c2-d3643e1eb608 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:47.887370 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-aa1f403e-dff2-41fa-94c2-d3643e1eb608 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1554 microversion: 2.1 time: 0.257247 Sep 13 01:19:47.905834 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 87/184] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:47 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1554 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:47.913341 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8d09ad62-8fd4-4629-830d-4f85052fc1ba tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:47.914198 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-8d09ad62-8fd4-4629-830d-4f85052fc1ba tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:47.924820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d09ad62-8fd4-4629-830d-4f85052fc1ba tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:47.926191 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d09ad62-8fd4-4629-830d-4f85052fc1ba tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:47.926792 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d09ad62-8fd4-4629-830d-4f85052fc1ba tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:47.927734 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d09ad62-8fd4-4629-830d-4f85052fc1ba tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:47.928350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d09ad62-8fd4-4629-830d-4f85052fc1ba tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:47.929513 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d09ad62-8fd4-4629-830d-4f85052fc1ba tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:47.993039 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-132c47c1-a02c-44e8-9bd8-d1a3d33d3b81 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:48.006878 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-132c47c1-a02c-44e8-9bd8-d1a3d33d3b81 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1315 microversion: 2.1 time: 0.615788 Sep 13 01:19:48.008125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 98/185] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:47 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1315 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:48.129208 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-8d09ad62-8fd4-4629-830d-4f85052fc1ba tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:48.139409 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-8d09ad62-8fd4-4629-830d-4f85052fc1ba tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.232188 Sep 13 01:19:48.140180 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 88/186] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:47 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:48.914968 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d4718ecf-6d9e-4fe0-a110-75dde63fe993 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:48.917628 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d4718ecf-6d9e-4fe0-a110-75dde63fe993 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:48.925390 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4718ecf-6d9e-4fe0-a110-75dde63fe993 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:48.925771 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4718ecf-6d9e-4fe0-a110-75dde63fe993 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:48.926210 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4718ecf-6d9e-4fe0-a110-75dde63fe993 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:48.928866 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4718ecf-6d9e-4fe0-a110-75dde63fe993 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:48.929513 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4718ecf-6d9e-4fe0-a110-75dde63fe993 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:48.930086 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d4718ecf-6d9e-4fe0-a110-75dde63fe993 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:49.037418 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1c75e067-3bd6-4b93-90f6-ece08e5fb827 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:49.038039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1c75e067-3bd6-4b93-90f6-ece08e5fb827 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:49.056010 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1c75e067-3bd6-4b93-90f6-ece08e5fb827 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:49.060150 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1c75e067-3bd6-4b93-90f6-ece08e5fb827 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:49.060622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1c75e067-3bd6-4b93-90f6-ece08e5fb827 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:49.061600 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1c75e067-3bd6-4b93-90f6-ece08e5fb827 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:49.062058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1c75e067-3bd6-4b93-90f6-ece08e5fb827 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:49.062477 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1c75e067-3bd6-4b93-90f6-ece08e5fb827 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:49.263112 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1c75e067-3bd6-4b93-90f6-ece08e5fb827 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:49.274406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1c75e067-3bd6-4b93-90f6-ece08e5fb827 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1315 microversion: 2.1 time: 0.240975 Sep 13 01:19:49.276134 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 89/187] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:49 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:49.283787 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a4198ae2-f0e9-469b-84ff-b84ff0b7aba5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:49.289331 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a4198ae2-f0e9-469b-84ff-b84ff0b7aba5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:49.317249 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a4198ae2-f0e9-469b-84ff-b84ff0b7aba5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:49.321820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a4198ae2-f0e9-469b-84ff-b84ff0b7aba5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:49.322959 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a4198ae2-f0e9-469b-84ff-b84ff0b7aba5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:49.323843 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a4198ae2-f0e9-469b-84ff-b84ff0b7aba5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:49.324452 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a4198ae2-f0e9-469b-84ff-b84ff0b7aba5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:49.325025 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a4198ae2-f0e9-469b-84ff-b84ff0b7aba5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:49.331612 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d4718ecf-6d9e-4fe0-a110-75dde63fe993 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:49.341267 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d4718ecf-6d9e-4fe0-a110-75dde63fe993 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1554 microversion: 2.1 time: 0.431607 Sep 13 01:19:49.350158 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 99/188] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:48 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1554 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:49.591770 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a4198ae2-f0e9-469b-84ff-b84ff0b7aba5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:49.601617 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a4198ae2-f0e9-469b-84ff-b84ff0b7aba5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.324063 Sep 13 01:19:49.602263 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 90/189] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:49 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:50.307092 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5c90d272-a53c-4f63-a04f-304741501f1c tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:50.307908 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5c90d272-a53c-4f63-a04f-304741501f1c tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:50.322466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c90d272-a53c-4f63-a04f-304741501f1c tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:50.323672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c90d272-a53c-4f63-a04f-304741501f1c tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:50.324731 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c90d272-a53c-4f63-a04f-304741501f1c tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:50.328250 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c90d272-a53c-4f63-a04f-304741501f1c tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:50.331040 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c90d272-a53c-4f63-a04f-304741501f1c tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:50.331906 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5c90d272-a53c-4f63-a04f-304741501f1c tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:50.376143 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d23c8ad3-c6dc-469a-a0c4-425d7c037d81 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:50.377320 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d23c8ad3-c6dc-469a-a0c4-425d7c037d81 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:50.386269 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d23c8ad3-c6dc-469a-a0c4-425d7c037d81 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:50.386760 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d23c8ad3-c6dc-469a-a0c4-425d7c037d81 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:50.392143 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d23c8ad3-c6dc-469a-a0c4-425d7c037d81 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:50.393100 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d23c8ad3-c6dc-469a-a0c4-425d7c037d81 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:50.393681 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d23c8ad3-c6dc-469a-a0c4-425d7c037d81 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:50.396334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d23c8ad3-c6dc-469a-a0c4-425d7c037d81 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:50.539976 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5c90d272-a53c-4f63-a04f-304741501f1c tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:50.540551 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d23c8ad3-c6dc-469a-a0c4-425d7c037d81 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:50.548988 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5c90d272-a53c-4f63-a04f-304741501f1c tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1315 microversion: 2.1 time: 0.248664 Sep 13 01:19:50.549818 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 100/190] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:50 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:50.551648 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d23c8ad3-c6dc-469a-a0c4-425d7c037d81 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1512 microversion: 2.1 time: 0.179638 Sep 13 01:19:50.552367 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 91/191] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:50 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:50.609265 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-ebf199ab-ff9f-49c7-a083-40174e6bb84a req-9ed74f66-6537-44a7-9f5b-c9af419d794b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2a24ff77-efd2-4d53-b120-387e032d8e33", "name": "network-vif-deleted", "tag": "aa920202-f96d-4a78-9f35-43655e114baf"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:50.619087 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-ebf199ab-ff9f-49c7-a083-40174e6bb84a req-9ed74f66-6537-44a7-9f5b-c9af419d794b service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:50.619570 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-ebf199ab-ff9f-49c7-a083-40174e6bb84a req-9ed74f66-6537-44a7-9f5b-c9af419d794b service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:50.622276 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-ebf199ab-ff9f-49c7-a083-40174e6bb84a req-9ed74f66-6537-44a7-9f5b-c9af419d794b service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:50.631757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-ebf199ab-ff9f-49c7-a083-40174e6bb84a req-9ed74f66-6537-44a7-9f5b-c9af419d794b service nova] Creating event network-vif-deleted:aa920202-f96d-4a78-9f35-43655e114baf for instance 2a24ff77-efd2-4d53-b120-387e032d8e33 on hv-cinder-85694 Sep 13 01:19:50.635983 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-74e2d396-4bc3-4f04-85e1-6c252c4e14be tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:50.637902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-74e2d396-4bc3-4f04-85e1-6c252c4e14be tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:50.638186 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-ebf199ab-ff9f-49c7-a083-40174e6bb84a req-9ed74f66-6537-44a7-9f5b-c9af419d794b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033530 Sep 13 01:19:50.639541 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 101/192] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:19:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:19:50.650864 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-74e2d396-4bc3-4f04-85e1-6c252c4e14be tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:50.651444 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-74e2d396-4bc3-4f04-85e1-6c252c4e14be tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:50.654632 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-74e2d396-4bc3-4f04-85e1-6c252c4e14be tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:50.656251 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-74e2d396-4bc3-4f04-85e1-6c252c4e14be tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:50.657831 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-74e2d396-4bc3-4f04-85e1-6c252c4e14be tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:50.658336 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-74e2d396-4bc3-4f04-85e1-6c252c4e14be tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:50.870278 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-74e2d396-4bc3-4f04-85e1-6c252c4e14be tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:50.885424 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-74e2d396-4bc3-4f04-85e1-6c252c4e14be tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.260831 Sep 13 01:19:50.891464 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 92/193] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:50 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:51.578956 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:51.580263 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:51.583181 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-eadd1587-3a9a-4cb4-97c2-e7749e81e248 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:51.583957 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-eadd1587-3a9a-4cb4-97c2-e7749e81e248 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:51.589392 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:51.591165 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:51.591828 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:51.594622 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:51.595348 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:51.596418 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:51.613734 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-eadd1587-3a9a-4cb4-97c2-e7749e81e248 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:51.614791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-eadd1587-3a9a-4cb4-97c2-e7749e81e248 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:51.615263 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-eadd1587-3a9a-4cb4-97c2-e7749e81e248 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:51.620307 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-eadd1587-3a9a-4cb4-97c2-e7749e81e248 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:51.620815 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-eadd1587-3a9a-4cb4-97c2-e7749e81e248 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:51.623277 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-eadd1587-3a9a-4cb4-97c2-e7749e81e248 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:51.640538 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:51.641898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:51.642571 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:51.643281 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lazy-loading 'fault' on Instance uuid 2a24ff77-efd2-4d53-b120-387e032d8e33 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:19:51.720169 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '06797d4f56954444b3317f2339f020c4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6475b1b1e54c4b0eb86021d82021de78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:51.731921 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9867c5be-1e2e-4489-a0af-ad9e375f7d59 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 200 len: 1350 microversion: 2.1 time: 0.156975 Sep 13 01:19:51.734920 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 102/194] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:51 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 1350 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:51.911471 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4bd791e5-459e-4e7b-9ab5-211469f6e4f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:51.912648 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4bd791e5-459e-4e7b-9ab5-211469f6e4f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:51.927466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bd791e5-459e-4e7b-9ab5-211469f6e4f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:51.927785 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bd791e5-459e-4e7b-9ab5-211469f6e4f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:51.930294 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bd791e5-459e-4e7b-9ab5-211469f6e4f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:51.932603 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bd791e5-459e-4e7b-9ab5-211469f6e4f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:51.935343 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bd791e5-459e-4e7b-9ab5-211469f6e4f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:51.937294 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4bd791e5-459e-4e7b-9ab5-211469f6e4f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:52.164177 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4bd791e5-459e-4e7b-9ab5-211469f6e4f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:52.168359 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:52.177221 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4bd791e5-459e-4e7b-9ab5-211469f6e4f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.271053 Sep 13 01:19:52.178348 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 103/195] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:51 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:52.207528 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-eadd1587-3a9a-4cb4-97c2-e7749e81e248 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:52.225712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-eadd1587-3a9a-4cb4-97c2-e7749e81e248 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1315 microversion: 2.1 time: 0.646981 Sep 13 01:19:52.241292 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 93/196] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:51 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1315 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:52.757715 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-94ee9459-29c6-4c08-bd44-4052f78927cc tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:52.758590 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-94ee9459-29c6-4c08-bd44-4052f78927cc tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:52.769404 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94ee9459-29c6-4c08-bd44-4052f78927cc tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:52.769977 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94ee9459-29c6-4c08-bd44-4052f78927cc tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:52.770486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94ee9459-29c6-4c08-bd44-4052f78927cc tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:52.771329 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94ee9459-29c6-4c08-bd44-4052f78927cc tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:52.771847 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94ee9459-29c6-4c08-bd44-4052f78927cc tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:52.772463 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94ee9459-29c6-4c08-bd44-4052f78927cc tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:52.792230 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-94ee9459-29c6-4c08-bd44-4052f78927cc tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] HTTP exception thrown: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-94ee9459-29c6-4c08-bd44-4052f78927cc tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Request method failure captured: Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 HTTP/1.1 Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9p8oKxCGDPsbfAPgYnhdwV35ly5GfyrQq_oguMuCOH8t7IF6L5cOsTQ3EyVzu02zE_rjhkzb_ZRN8qyCtf2EOWUzNHeuzA_C900XhgZO9JmpzSDm3yQsjdzig3dcJSE_fwh-yZTcyiRnbof89CXalVLnRp8S2K9T0_AwU2jGqK-iJg Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 6475b1b1e54c4b0eb86021d82021de78 Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-DeleteServersTestJSON-148812331 Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:19:52.798732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:19:52.800269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6475b1b1e54c4b0eb86021d82021de78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6475b1b1e54c4b0eb86021d82021de78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6475b1b1e54c4b0eb86021d82021de78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6475b1b1e54c4b0eb86021d82021de78"}]}] Sep 13 01:19:52.800269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-DeleteServersTestJSON-148812331 Sep 13 01:19:52.800269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 6475b1b1e54c4b0eb86021d82021de78 Sep 13 01:19:52.800269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-DeleteServersTestJSON-148812331 Sep 13 01:19:52.800269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-DeleteServersTestJSON-148812331-project Sep 13 01:19:52.800269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:19:52.800269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:19:52.800269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 06797d4f56954444b3317f2339f020c4 Sep 13 01:19:52.800269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-DeleteServersTestJSON-148812331-project Sep 13 01:19:52.800269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:19:52.800269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:52.800269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '2a24ff77-efd2-4d53-b120-387e032d8e33'} Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:19:52.801024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:52.802191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:19:52.803197 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-94ee9459-29c6-4c08-bd44-4052f78927cc tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Returning 404 to user: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:19:52.803197 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-94ee9459-29c6-4c08-bd44-4052f78927cc tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 404 len: 111 microversion: 2.1 time: 0.047753 Sep 13 01:19:52.814409 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 104/197] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:52 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:19:52.931467 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b34377a1-169b-45b0-8165-01f85e8611be tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:52.933699 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b34377a1-169b-45b0-8165-01f85e8611be tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:52.940387 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b34377a1-169b-45b0-8165-01f85e8611be tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:52.940876 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b34377a1-169b-45b0-8165-01f85e8611be tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:52.941318 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b34377a1-169b-45b0-8165-01f85e8611be tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:52.942012 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b34377a1-169b-45b0-8165-01f85e8611be tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:52.942664 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b34377a1-169b-45b0-8165-01f85e8611be tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:52.943755 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b34377a1-169b-45b0-8165-01f85e8611be tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:52.961526 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-b34377a1-169b-45b0-8165-01f85e8611be tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] HTTP exception thrown: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b34377a1-169b-45b0-8165-01f85e8611be tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Request method failure captured: Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33/os-volume_attachments HTTP/1.1 Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9p8oKxCGDPsbfAPgYnhdwV35ly5GfyrQq_oguMuCOH8t7IF6L5cOsTQ3EyVzu02zE_rjhkzb_ZRN8qyCtf2EOWUzNHeuzA_C900XhgZO9JmpzSDm3yQsjdzig3dcJSE_fwh-yZTcyiRnbof89CXalVLnRp8S2K9T0_AwU2jGqK-iJg Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 6475b1b1e54c4b0eb86021d82021de78 Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-DeleteServersTestJSON-148812331 Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:19:52.973521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:19:52.974838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6475b1b1e54c4b0eb86021d82021de78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6475b1b1e54c4b0eb86021d82021de78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6475b1b1e54c4b0eb86021d82021de78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6475b1b1e54c4b0eb86021d82021de78"}]}] Sep 13 01:19:52.974838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-DeleteServersTestJSON-148812331 Sep 13 01:19:52.974838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 6475b1b1e54c4b0eb86021d82021de78 Sep 13 01:19:52.974838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-DeleteServersTestJSON-148812331 Sep 13 01:19:52.974838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-DeleteServersTestJSON-148812331-project Sep 13 01:19:52.974838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:19:52.974838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:19:52.974838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 06797d4f56954444b3317f2339f020c4 Sep 13 01:19:52.974838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-DeleteServersTestJSON-148812331-project Sep 13 01:19:52.974838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:19:52.974838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:52.974838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'server_id': '2a24ff77-efd2-4d53-b120-387e032d8e33'} Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:19:52.976220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:52.977376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:19:52.980876 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b34377a1-169b-45b0-8165-01f85e8611be tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Returning 404 to user: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:19:52.982071 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b34377a1-169b-45b0-8165-01f85e8611be tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.054535 Sep 13 01:19:52.983244 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 94/198] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:19:52 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33/os-volume_attachments => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:19:53.204049 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3b59b313-b2c7-41e1-b420-73d0618f0aa0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:53.205132 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3b59b313-b2c7-41e1-b420-73d0618f0aa0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:53.212310 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b59b313-b2c7-41e1-b420-73d0618f0aa0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:53.212948 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b59b313-b2c7-41e1-b420-73d0618f0aa0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:53.213595 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b59b313-b2c7-41e1-b420-73d0618f0aa0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:53.214789 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b59b313-b2c7-41e1-b420-73d0618f0aa0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:53.215470 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b59b313-b2c7-41e1-b420-73d0618f0aa0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:53.216230 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b59b313-b2c7-41e1-b420-73d0618f0aa0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:53.250401 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-945b665a-3c80-459e-8803-6d88c483d68e tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:53.252173 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-945b665a-3c80-459e-8803-6d88c483d68e tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:53.265450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-945b665a-3c80-459e-8803-6d88c483d68e tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:53.267108 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-945b665a-3c80-459e-8803-6d88c483d68e tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:53.269413 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-945b665a-3c80-459e-8803-6d88c483d68e tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:53.271841 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-945b665a-3c80-459e-8803-6d88c483d68e tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:53.272502 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-945b665a-3c80-459e-8803-6d88c483d68e tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:53.283510 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-945b665a-3c80-459e-8803-6d88c483d68e tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:53.532608 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3b59b313-b2c7-41e1-b420-73d0618f0aa0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:53.543197 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3b59b313-b2c7-41e1-b420-73d0618f0aa0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.344923 Sep 13 01:19:53.544345 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 105/199] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:53 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:53.775039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-945b665a-3c80-459e-8803-6d88c483d68e tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:53.791910 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-945b665a-3c80-459e-8803-6d88c483d68e tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1315 microversion: 2.1 time: 0.545357 Sep 13 01:19:53.797260 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 95/200] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:53 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1315 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:54.238456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b0aa168a-0990-40d2-8192-3798f21b012c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:54.239599 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b0aa168a-0990-40d2-8192-3798f21b012c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:54.254880 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0aa168a-0990-40d2-8192-3798f21b012c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:54.255567 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0aa168a-0990-40d2-8192-3798f21b012c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:54.256019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0aa168a-0990-40d2-8192-3798f21b012c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:54.256741 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0aa168a-0990-40d2-8192-3798f21b012c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:54.257417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0aa168a-0990-40d2-8192-3798f21b012c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:54.258034 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0aa168a-0990-40d2-8192-3798f21b012c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:54.294629 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-b0aa168a-0990-40d2-8192-3798f21b012c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] HTTP exception thrown: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b0aa168a-0990-40d2-8192-3798f21b012c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Request method failure captured: Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 HTTP/1.1 Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9p8oKxCGDPsbfAPgYnhdwV35ly5GfyrQq_oguMuCOH8t7IF6L5cOsTQ3EyVzu02zE_rjhkzb_ZRN8qyCtf2EOWUzNHeuzA_C900XhgZO9JmpzSDm3yQsjdzig3dcJSE_fwh-yZTcyiRnbof89CXalVLnRp8S2K9T0_AwU2jGqK-iJg Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 6475b1b1e54c4b0eb86021d82021de78 Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-DeleteServersTestJSON-148812331 Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:19:54.296508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:19:54.297664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6475b1b1e54c4b0eb86021d82021de78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6475b1b1e54c4b0eb86021d82021de78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6475b1b1e54c4b0eb86021d82021de78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6475b1b1e54c4b0eb86021d82021de78"}]}] Sep 13 01:19:54.297664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-DeleteServersTestJSON-148812331 Sep 13 01:19:54.297664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 6475b1b1e54c4b0eb86021d82021de78 Sep 13 01:19:54.297664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-DeleteServersTestJSON-148812331 Sep 13 01:19:54.297664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-DeleteServersTestJSON-148812331-project Sep 13 01:19:54.297664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:19:54.297664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:19:54.297664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 06797d4f56954444b3317f2339f020c4 Sep 13 01:19:54.297664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-DeleteServersTestJSON-148812331-project Sep 13 01:19:54.297664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:19:54.297664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:54.297664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '2a24ff77-efd2-4d53-b120-387e032d8e33'} Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:19:54.298312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:54.299389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:19:54.302086 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b0aa168a-0990-40d2-8192-3798f21b012c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Returning 404 to user: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:19:54.303207 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b0aa168a-0990-40d2-8192-3798f21b012c tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 404 len: 111 microversion: 2.1 time: 0.068739 Sep 13 01:19:54.303981 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 106/201] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:19:54 2022] DELETE /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 111 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:19:54.312768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a90e1e4c-9a27-4d6b-a07a-7ca180222f30 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:54.313450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a90e1e4c-9a27-4d6b-a07a-7ca180222f30 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] [instance: 2a24ff77-efd2-4d53-b120-387e032d8e33] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:54.323778 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a90e1e4c-9a27-4d6b-a07a-7ca180222f30 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:54.324269 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a90e1e4c-9a27-4d6b-a07a-7ca180222f30 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:54.324699 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a90e1e4c-9a27-4d6b-a07a-7ca180222f30 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:54.326306 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a90e1e4c-9a27-4d6b-a07a-7ca180222f30 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:54.326968 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a90e1e4c-9a27-4d6b-a07a-7ca180222f30 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:54.327608 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a90e1e4c-9a27-4d6b-a07a-7ca180222f30 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:54.344806 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-a90e1e4c-9a27-4d6b-a07a-7ca180222f30 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] HTTP exception thrown: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a90e1e4c-9a27-4d6b-a07a-7ca180222f30 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Request method failure captured: Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 HTTP/1.1 Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9p8oKxCGDPsbfAPgYnhdwV35ly5GfyrQq_oguMuCOH8t7IF6L5cOsTQ3EyVzu02zE_rjhkzb_ZRN8qyCtf2EOWUzNHeuzA_C900XhgZO9JmpzSDm3yQsjdzig3dcJSE_fwh-yZTcyiRnbof89CXalVLnRp8S2K9T0_AwU2jGqK-iJg Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 6475b1b1e54c4b0eb86021d82021de78 Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-DeleteServersTestJSON-148812331 Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:19:54.355724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:19:54.357476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_6475b1b1e54c4b0eb86021d82021de78"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6475b1b1e54c4b0eb86021d82021de78"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/6475b1b1e54c4b0eb86021d82021de78"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/6475b1b1e54c4b0eb86021d82021de78"}]}] Sep 13 01:19:54.357476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-DeleteServersTestJSON-148812331 Sep 13 01:19:54.357476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 6475b1b1e54c4b0eb86021d82021de78 Sep 13 01:19:54.357476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-DeleteServersTestJSON-148812331 Sep 13 01:19:54.357476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-DeleteServersTestJSON-148812331-project Sep 13 01:19:54.357476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:19:54.357476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:19:54.357476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 06797d4f56954444b3317f2339f020c4 Sep 13 01:19:54.357476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-DeleteServersTestJSON-148812331-project Sep 13 01:19:54.357476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:19:54.357476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:54.357476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '2a24ff77-efd2-4d53-b120-387e032d8e33'} Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:19:54.358146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. Sep 13 01:19:54.359188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:19:54.364800 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a90e1e4c-9a27-4d6b-a07a-7ca180222f30 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] Returning 404 to user: Instance 2a24ff77-efd2-4d53-b120-387e032d8e33 could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:19:54.366064 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a90e1e4c-9a27-4d6b-a07a-7ca180222f30 tempest-DeleteServersTestJSON-148812331 tempest-DeleteServersTestJSON-148812331-project] 10.222.0.15 "GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33" status: 404 len: 111 microversion: 2.1 time: 0.057951 Sep 13 01:19:54.370501 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 96/202] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:54 2022] GET /compute/v2.1/servers/2a24ff77-efd2-4d53-b120-387e032d8e33 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:19:54.569749 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fc1448bd-0241-463a-8bba-4b7bb4d9efa3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:54.570362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fc1448bd-0241-463a-8bba-4b7bb4d9efa3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:54.581230 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fc1448bd-0241-463a-8bba-4b7bb4d9efa3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:54.581726 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fc1448bd-0241-463a-8bba-4b7bb4d9efa3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:54.582165 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fc1448bd-0241-463a-8bba-4b7bb4d9efa3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:54.592389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fc1448bd-0241-463a-8bba-4b7bb4d9efa3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:54.594243 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fc1448bd-0241-463a-8bba-4b7bb4d9efa3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:54.594883 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fc1448bd-0241-463a-8bba-4b7bb4d9efa3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:54.820749 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-594ccf76-2df6-49c8-91e7-3f97a890c4c0 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:54.821355 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-594ccf76-2df6-49c8-91e7-3f97a890c4c0 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:54.833641 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-594ccf76-2df6-49c8-91e7-3f97a890c4c0 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:54.834187 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-594ccf76-2df6-49c8-91e7-3f97a890c4c0 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:54.834627 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-594ccf76-2df6-49c8-91e7-3f97a890c4c0 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:54.841890 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-594ccf76-2df6-49c8-91e7-3f97a890c4c0 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:54.844033 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-594ccf76-2df6-49c8-91e7-3f97a890c4c0 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:54.844682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-594ccf76-2df6-49c8-91e7-3f97a890c4c0 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:54.891697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fc1448bd-0241-463a-8bba-4b7bb4d9efa3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:54.903867 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fc1448bd-0241-463a-8bba-4b7bb4d9efa3 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.338569 Sep 13 01:19:54.909131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 107/203] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:54 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:55.908537 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-594ccf76-2df6-49c8-91e7-3f97a890c4c0 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:55.919899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-594ccf76-2df6-49c8-91e7-3f97a890c4c0 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1315 microversion: 2.1 time: 1.103068 Sep 13 01:19:55.930834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ad2504cc-ac6e-41bd-aa38-959ada9b354b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:55.931623 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ad2504cc-ac6e-41bd-aa38-959ada9b354b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:55.943004 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 97/204] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:54 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1315 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:55.945898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad2504cc-ac6e-41bd-aa38-959ada9b354b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:55.946479 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad2504cc-ac6e-41bd-aa38-959ada9b354b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:55.947083 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad2504cc-ac6e-41bd-aa38-959ada9b354b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:55.947859 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad2504cc-ac6e-41bd-aa38-959ada9b354b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:55.950213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad2504cc-ac6e-41bd-aa38-959ada9b354b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:55.951013 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ad2504cc-ac6e-41bd-aa38-959ada9b354b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:56.453415 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ad2504cc-ac6e-41bd-aa38-959ada9b354b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:56.467867 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ad2504cc-ac6e-41bd-aa38-959ada9b354b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.541858 Sep 13 01:19:56.469054 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 108/205] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:55 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:56.541628 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-29103073-74e8-4ab4-a708-037873a22747 req-2f2435c7-e357-4977-9851-805813f50baa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b3a740-470d-4918-88b1-aa761182fc2a", "name": "network-vif-plugged", "status": "completed", "tag": "b78fe83e-11a7-4b62-bf91-c14c14bb0a62"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:19:56.561322 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-29103073-74e8-4ab4-a708-037873a22747 req-2f2435c7-e357-4977-9851-805813f50baa service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:56.562400 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-29103073-74e8-4ab4-a708-037873a22747 req-2f2435c7-e357-4977-9851-805813f50baa service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:56.563239 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-29103073-74e8-4ab4-a708-037873a22747 req-2f2435c7-e357-4977-9851-805813f50baa service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:56.578573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-29103073-74e8-4ab4-a708-037873a22747 req-2f2435c7-e357-4977-9851-805813f50baa service nova] Creating event network-vif-plugged:b78fe83e-11a7-4b62-bf91-c14c14bb0a62 for instance a6b3a740-470d-4918-88b1-aa761182fc2a on hv-cinder-85694 Sep 13 01:19:56.589798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-29103073-74e8-4ab4-a708-037873a22747 req-2f2435c7-e357-4977-9851-805813f50baa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052887 Sep 13 01:19:56.594945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 98/206] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:19:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:19:56.950386 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-332747a6-a5a0-48a7-9135-b7c296a07415 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:56.951289 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-332747a6-a5a0-48a7-9135-b7c296a07415 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:56.957723 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-332747a6-a5a0-48a7-9135-b7c296a07415 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:56.958469 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-332747a6-a5a0-48a7-9135-b7c296a07415 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:56.959162 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-332747a6-a5a0-48a7-9135-b7c296a07415 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:56.968838 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-332747a6-a5a0-48a7-9135-b7c296a07415 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:56.969581 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-332747a6-a5a0-48a7-9135-b7c296a07415 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:56.970205 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-332747a6-a5a0-48a7-9135-b7c296a07415 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:57.274741 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-332747a6-a5a0-48a7-9135-b7c296a07415 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:57.293395 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-332747a6-a5a0-48a7-9135-b7c296a07415 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1315 microversion: 2.1 time: 0.347516 Sep 13 01:19:57.295219 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 109/207] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:56 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1315 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:57.494119 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3177cbb2-d3c7-496d-96e0-2ce0de0615e1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:57.495507 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3177cbb2-d3c7-496d-96e0-2ce0de0615e1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:57.515712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3177cbb2-d3c7-496d-96e0-2ce0de0615e1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:57.516220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3177cbb2-d3c7-496d-96e0-2ce0de0615e1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:57.516893 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3177cbb2-d3c7-496d-96e0-2ce0de0615e1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:57.520462 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3177cbb2-d3c7-496d-96e0-2ce0de0615e1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:57.523810 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3177cbb2-d3c7-496d-96e0-2ce0de0615e1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:57.524374 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3177cbb2-d3c7-496d-96e0-2ce0de0615e1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:57.856278 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3177cbb2-d3c7-496d-96e0-2ce0de0615e1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:57.865690 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3177cbb2-d3c7-496d-96e0-2ce0de0615e1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.376169 Sep 13 01:19:57.881260 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 99/208] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:57 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:58.319759 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3c6cd5d1-3dd9-4dda-ac6b-4822bfe0dc43 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:58.320901 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3c6cd5d1-3dd9-4dda-ac6b-4822bfe0dc43 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:58.337805 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c6cd5d1-3dd9-4dda-ac6b-4822bfe0dc43 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:58.340915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c6cd5d1-3dd9-4dda-ac6b-4822bfe0dc43 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:58.341608 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c6cd5d1-3dd9-4dda-ac6b-4822bfe0dc43 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:58.342591 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c6cd5d1-3dd9-4dda-ac6b-4822bfe0dc43 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:58.344415 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c6cd5d1-3dd9-4dda-ac6b-4822bfe0dc43 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:58.345070 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3c6cd5d1-3dd9-4dda-ac6b-4822bfe0dc43 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:58.559940 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3c6cd5d1-3dd9-4dda-ac6b-4822bfe0dc43 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:58.575929 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3c6cd5d1-3dd9-4dda-ac6b-4822bfe0dc43 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1463 microversion: 2.1 time: 0.257196 Sep 13 01:19:58.577136 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 110/209] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:58 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1463 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:58.649727 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d72bc595-5869-40e0-b655-2b9d3c00ac05 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:58.650259 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d72bc595-5869-40e0-b655-2b9d3c00ac05 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:58.663445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d72bc595-5869-40e0-b655-2b9d3c00ac05 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:58.668283 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d72bc595-5869-40e0-b655-2b9d3c00ac05 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:58.670885 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d72bc595-5869-40e0-b655-2b9d3c00ac05 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:58.671857 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d72bc595-5869-40e0-b655-2b9d3c00ac05 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:58.672741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d72bc595-5869-40e0-b655-2b9d3c00ac05 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:58.675708 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d72bc595-5869-40e0-b655-2b9d3c00ac05 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:58.680925 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:19:58.729819 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d72bc595-5869-40e0-b655-2b9d3c00ac05 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Going to try to terminate instance {{(pid=120412) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:19:58.888192 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d72bc595-5869-40e0-b655-2b9d3c00ac05 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 204 len: 0 microversion: 2.1 time: 0.241937 Sep 13 01:19:58.889652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 100/210] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:19:58 2022] DELETE /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:19:58.892222 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3797e667-1ae5-429d-8018-b3fcf43a3c59 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:58.893268 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3797e667-1ae5-429d-8018-b3fcf43a3c59 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:58.900950 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-408fa52e-2e74-4f71-a6d7-1878bc4211bd tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:19:58.901671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-408fa52e-2e74-4f71-a6d7-1878bc4211bd tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:19:58.910100 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3797e667-1ae5-429d-8018-b3fcf43a3c59 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:58.911901 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3797e667-1ae5-429d-8018-b3fcf43a3c59 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:58.912433 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3797e667-1ae5-429d-8018-b3fcf43a3c59 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:58.913152 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3797e667-1ae5-429d-8018-b3fcf43a3c59 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:58.917855 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3797e667-1ae5-429d-8018-b3fcf43a3c59 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:58.918581 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-408fa52e-2e74-4f71-a6d7-1878bc4211bd tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:58.918971 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3797e667-1ae5-429d-8018-b3fcf43a3c59 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:58.921458 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-408fa52e-2e74-4f71-a6d7-1878bc4211bd tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:58.922184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-408fa52e-2e74-4f71-a6d7-1878bc4211bd tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:58.924487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-408fa52e-2e74-4f71-a6d7-1878bc4211bd tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:19:58.933375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-408fa52e-2e74-4f71-a6d7-1878bc4211bd tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:19:58.934521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-408fa52e-2e74-4f71-a6d7-1878bc4211bd tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:19:59.149212 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3797e667-1ae5-429d-8018-b3fcf43a3c59 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:59.157999 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3797e667-1ae5-429d-8018-b3fcf43a3c59 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.270604 Sep 13 01:19:59.159254 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 111/211] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:58 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:19:59.356383 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-408fa52e-2e74-4f71-a6d7-1878bc4211bd tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:19:59.366334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-408fa52e-2e74-4f71-a6d7-1878bc4211bd tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1469 microversion: 2.1 time: 0.471452 Sep 13 01:19:59.379204 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 101/212] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:19:58 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1469 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:19:59.959888 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c51f1629-f4d2-4b2e-beeb-750c6e16d0cf tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Action: 'create', calling method: .version_select at 0x7fb05e5ebca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-758260512", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIy441xIOAXyBOpb5bQlgkDJFNs2PLAVIuxYuF2hkzFsn8LPx2wBdaroPFOASVmWBuabMM0OsUumHOyOyK8Ap7rIPpjwUn9pCLELRE+qtyNBupxftTSl6t1TYTTeZprRPA=="}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:00.013659 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-c51f1629-f4d2-4b2e-beeb-750c6e16d0cf tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Getting quotas for project de31bd722d4f419d9269b519af7f793a. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:20:00.032265 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-c51f1629-f4d2-4b2e-beeb-750c6e16d0cf tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Getting quotas for user 85178dc2280c4a54970fc207d1746608 and project de31bd722d4f419d9269b519af7f793a. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:20:00.099041 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c51f1629-f4d2-4b2e-beeb-750c6e16d0cf tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.441724 Sep 13 01:20:00.100289 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 112/213] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 01:19:59 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:20:00.182336 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-dca8600a-c464-419c-a30c-4aed5c77ded9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:00.187803 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-dca8600a-c464-419c-a30c-4aed5c77ded9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:00.204038 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dca8600a-c464-419c-a30c-4aed5c77ded9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:00.205512 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dca8600a-c464-419c-a30c-4aed5c77ded9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:00.206934 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dca8600a-c464-419c-a30c-4aed5c77ded9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:00.208660 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dca8600a-c464-419c-a30c-4aed5c77ded9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:00.209684 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dca8600a-c464-419c-a30c-4aed5c77ded9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:00.211482 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dca8600a-c464-419c-a30c-4aed5c77ded9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:00.423318 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-45d136d4-a525-4062-acdb-8f6db9b879d9 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:00.424196 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-45d136d4-a525-4062-acdb-8f6db9b879d9 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:00.456423 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-45d136d4-a525-4062-acdb-8f6db9b879d9 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:00.456927 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-45d136d4-a525-4062-acdb-8f6db9b879d9 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:00.457369 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-45d136d4-a525-4062-acdb-8f6db9b879d9 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:00.458088 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-45d136d4-a525-4062-acdb-8f6db9b879d9 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:00.458545 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-45d136d4-a525-4062-acdb-8f6db9b879d9 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:00.459000 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-45d136d4-a525-4062-acdb-8f6db9b879d9 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:00.654499 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-dca8600a-c464-419c-a30c-4aed5c77ded9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:00.664651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-dca8600a-c464-419c-a30c-4aed5c77ded9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.486614 Sep 13 01:20:00.672710 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 102/214] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:00 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:01.020502 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-45d136d4-a525-4062-acdb-8f6db9b879d9 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:01.051383 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-45d136d4-a525-4062-acdb-8f6db9b879d9 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1469 microversion: 2.1 time: 0.642685 Sep 13 01:20:01.053058 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 113/215] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:00 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1469 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:01.700180 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-52e50733-d512-4022-81c8-d08894342f2b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:01.700842 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-52e50733-d512-4022-81c8-d08894342f2b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:01.707061 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-52e50733-d512-4022-81c8-d08894342f2b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:01.707558 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-52e50733-d512-4022-81c8-d08894342f2b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:01.707993 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-52e50733-d512-4022-81c8-d08894342f2b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:01.708695 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-52e50733-d512-4022-81c8-d08894342f2b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:01.709201 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-52e50733-d512-4022-81c8-d08894342f2b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:01.709817 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-52e50733-d512-4022-81c8-d08894342f2b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:02.097378 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7d165e80-4647-446c-97da-7269c49c5a44 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:02.098667 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7d165e80-4647-446c-97da-7269c49c5a44 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:02.103731 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:02.104377 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-52e50733-d512-4022-81c8-d08894342f2b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:02.118953 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-52e50733-d512-4022-81c8-d08894342f2b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.428970 Sep 13 01:20:02.120128 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 103/216] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:01 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:02.144632 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7d165e80-4647-446c-97da-7269c49c5a44 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:02.145581 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7d165e80-4647-446c-97da-7269c49c5a44 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:02.146248 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7d165e80-4647-446c-97da-7269c49c5a44 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:02.148186 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7d165e80-4647-446c-97da-7269c49c5a44 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:02.149259 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7d165e80-4647-446c-97da-7269c49c5a44 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:02.149952 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7d165e80-4647-446c-97da-7269c49c5a44 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:02.238286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-6c800e3e-e715-4203-b8bb-00322d2daa3b req-4529dbf1-f13d-4467-a1cf-c7ca555b3614 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a6b3a740-470d-4918-88b1-aa761182fc2a", "name": "network-vif-deleted", "tag": "b78fe83e-11a7-4b62-bf91-c14c14bb0a62"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:02.271335 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-6c800e3e-e715-4203-b8bb-00322d2daa3b req-4529dbf1-f13d-4467-a1cf-c7ca555b3614 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:02.273249 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-6c800e3e-e715-4203-b8bb-00322d2daa3b req-4529dbf1-f13d-4467-a1cf-c7ca555b3614 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:02.273717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-6c800e3e-e715-4203-b8bb-00322d2daa3b req-4529dbf1-f13d-4467-a1cf-c7ca555b3614 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:02.300569 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-6c800e3e-e715-4203-b8bb-00322d2daa3b req-4529dbf1-f13d-4467-a1cf-c7ca555b3614 service nova] Creating event network-vif-deleted:b78fe83e-11a7-4b62-bf91-c14c14bb0a62 for instance a6b3a740-470d-4918-88b1-aa761182fc2a on hv-cinder-85694 Sep 13 01:20:02.308014 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-6c800e3e-e715-4203-b8bb-00322d2daa3b req-4529dbf1-f13d-4467-a1cf-c7ca555b3614 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074499 Sep 13 01:20:02.309002 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 104/217] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:20:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:20:02.679095 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7d165e80-4647-446c-97da-7269c49c5a44 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93409ebeeab6464abf34f26ebd37a2a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0422bd9612349b8a0cbcae6f1a588b7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:02.699152 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7d165e80-4647-446c-97da-7269c49c5a44 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 200 len: 1427 microversion: 2.1 time: 0.625496 Sep 13 01:20:02.700981 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 114/218] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:02 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 1427 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:03.145168 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4539422f-1af9-48b6-9716-5223e1ded497 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:03.145960 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4539422f-1af9-48b6-9716-5223e1ded497 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:03.159924 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4539422f-1af9-48b6-9716-5223e1ded497 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:03.162297 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4539422f-1af9-48b6-9716-5223e1ded497 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:03.162701 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4539422f-1af9-48b6-9716-5223e1ded497 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:03.163468 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4539422f-1af9-48b6-9716-5223e1ded497 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:03.169975 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4539422f-1af9-48b6-9716-5223e1ded497 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:03.170642 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4539422f-1af9-48b6-9716-5223e1ded497 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:03.442233 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4539422f-1af9-48b6-9716-5223e1ded497 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:03.453407 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4539422f-1af9-48b6-9716-5223e1ded497 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.312830 Sep 13 01:20:03.473914 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 105/219] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:03 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:03.733203 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-779fbc85-7f14-4ce0-99c8-477b2a4713a1 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:03.734398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-779fbc85-7f14-4ce0-99c8-477b2a4713a1 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] [instance: a6b3a740-470d-4918-88b1-aa761182fc2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:03.743364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-779fbc85-7f14-4ce0-99c8-477b2a4713a1 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:03.744075 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-779fbc85-7f14-4ce0-99c8-477b2a4713a1 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:03.745280 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-779fbc85-7f14-4ce0-99c8-477b2a4713a1 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:03.746550 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-779fbc85-7f14-4ce0-99c8-477b2a4713a1 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:03.747757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-779fbc85-7f14-4ce0-99c8-477b2a4713a1 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:03.749980 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-779fbc85-7f14-4ce0-99c8-477b2a4713a1 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:03.765527 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-779fbc85-7f14-4ce0-99c8-477b2a4713a1 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] HTTP exception thrown: Instance a6b3a740-470d-4918-88b1-aa761182fc2a could not be found. Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-779fbc85-7f14-4ce0-99c8-477b2a4713a1 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Request method failure captured: Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a HTTP/1.1 Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9qlz_1rsRYhH0-46K8Fl3Kn3PAySsqzHlUkipoT0Z3pX12QS1UUtNp-72KTqGZ33KyuTa0nPK7cBE6mI5JcpmXOgBG5WLWdW64iX0ahvoTbjnOhBTFUyWQJPjvvX5R1EagRwejt_trMcVBpcwuRc5yXI4Na-owt-mnE7cAicr7ZImE Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: b0422bd9612349b8a0cbcae6f1a588b7 Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesNegativeTest-186569500 Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:20:03.767598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:20:03.768821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_b0422bd9612349b8a0cbcae6f1a588b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b0422bd9612349b8a0cbcae6f1a588b7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/b0422bd9612349b8a0cbcae6f1a588b7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/b0422bd9612349b8a0cbcae6f1a588b7"}]}] Sep 13 01:20:03.768821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesNegativeTest-186569500 Sep 13 01:20:03.768821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: b0422bd9612349b8a0cbcae6f1a588b7 Sep 13 01:20:03.768821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesNegativeTest-186569500 Sep 13 01:20:03.768821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesNegativeTest-186569500-project Sep 13 01:20:03.768821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:20:03.768821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:20:03.768821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 93409ebeeab6464abf34f26ebd37a2a9 Sep 13 01:20:03.768821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesNegativeTest-186569500-project Sep 13 01:20:03.768821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:20:03.768821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance a6b3a740-470d-4918-88b1-aa761182fc2a could not be found. Sep 13 01:20:03.768821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': 'a6b3a740-470d-4918-88b1-aa761182fc2a'} Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a6b3a740-470d-4918-88b1-aa761182fc2a could not be found. Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:20:03.769547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a6b3a740-470d-4918-88b1-aa761182fc2a could not be found. Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a6b3a740-470d-4918-88b1-aa761182fc2a could not be found. Sep 13 01:20:03.770641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:20:03.773665 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-779fbc85-7f14-4ce0-99c8-477b2a4713a1 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] Returning 404 to user: Instance a6b3a740-470d-4918-88b1-aa761182fc2a could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:20:03.774804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-779fbc85-7f14-4ce0-99c8-477b2a4713a1 tempest-VolumesNegativeTest-186569500 tempest-VolumesNegativeTest-186569500-project] 10.222.0.15 "GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a" status: 404 len: 111 microversion: 2.1 time: 0.046711 Sep 13 01:20:03.776338 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 115/220] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:03 2022] GET /compute/v2.1/servers/a6b3a740-470d-4918-88b1-aa761182fc2a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:20:04.478945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f386b23e-7534-4c59-9af9-984befa49011 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:04.479625 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-f386b23e-7534-4c59-9af9-984befa49011 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:04.490085 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f386b23e-7534-4c59-9af9-984befa49011 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:04.490894 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f386b23e-7534-4c59-9af9-984befa49011 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:04.491397 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f386b23e-7534-4c59-9af9-984befa49011 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:04.492472 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f386b23e-7534-4c59-9af9-984befa49011 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:04.493085 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f386b23e-7534-4c59-9af9-984befa49011 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:04.493763 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f386b23e-7534-4c59-9af9-984befa49011 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:04.678249 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f386b23e-7534-4c59-9af9-984befa49011 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:04.691633 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f386b23e-7534-4c59-9af9-984befa49011 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.216852 Sep 13 01:20:04.692144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 106/221] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:04 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:05.719726 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ac4b2fe9-9e3d-4d58-aa70-5d3322d32516 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:05.720661 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ac4b2fe9-9e3d-4d58-aa70-5d3322d32516 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:05.736173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac4b2fe9-9e3d-4d58-aa70-5d3322d32516 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:05.736722 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac4b2fe9-9e3d-4d58-aa70-5d3322d32516 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:05.737174 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac4b2fe9-9e3d-4d58-aa70-5d3322d32516 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:05.738525 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac4b2fe9-9e3d-4d58-aa70-5d3322d32516 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:05.741158 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac4b2fe9-9e3d-4d58-aa70-5d3322d32516 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:05.742638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac4b2fe9-9e3d-4d58-aa70-5d3322d32516 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:05.968751 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ac4b2fe9-9e3d-4d58-aa70-5d3322d32516 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:05.977705 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ac4b2fe9-9e3d-4d58-aa70-5d3322d32516 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.264583 Sep 13 01:20:05.979065 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 116/222] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:05 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:07.004000 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-15d63b4b-1f68-4016-b1f9-e86957d58d01 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:07.004479 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-15d63b4b-1f68-4016-b1f9-e86957d58d01 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:07.014632 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:07.017018 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-15d63b4b-1f68-4016-b1f9-e86957d58d01 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:07.017567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-15d63b4b-1f68-4016-b1f9-e86957d58d01 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:07.018008 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-15d63b4b-1f68-4016-b1f9-e86957d58d01 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:07.019805 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-15d63b4b-1f68-4016-b1f9-e86957d58d01 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:07.020275 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-15d63b4b-1f68-4016-b1f9-e86957d58d01 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:07.020715 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-15d63b4b-1f68-4016-b1f9-e86957d58d01 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:07.251873 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-15d63b4b-1f68-4016-b1f9-e86957d58d01 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:07.270227 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-15d63b4b-1f68-4016-b1f9-e86957d58d01 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.269852 Sep 13 01:20:07.271091 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 107/223] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:06 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:08.297901 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bdbaa419-6cf9-4d58-8d3c-4eb39827c16e tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:08.298523 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bdbaa419-6cf9-4d58-8d3c-4eb39827c16e tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:08.319405 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bdbaa419-6cf9-4d58-8d3c-4eb39827c16e tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:08.320563 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bdbaa419-6cf9-4d58-8d3c-4eb39827c16e tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:08.321714 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bdbaa419-6cf9-4d58-8d3c-4eb39827c16e tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:08.323516 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bdbaa419-6cf9-4d58-8d3c-4eb39827c16e tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:08.324841 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bdbaa419-6cf9-4d58-8d3c-4eb39827c16e tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:08.325488 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bdbaa419-6cf9-4d58-8d3c-4eb39827c16e tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:08.634199 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bdbaa419-6cf9-4d58-8d3c-4eb39827c16e tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:08.646331 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bdbaa419-6cf9-4d58-8d3c-4eb39827c16e tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.353834 Sep 13 01:20:08.649048 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 117/224] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:08 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:09.677650 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a110890b-e657-43a2-b236-6f1b217b0202 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:09.678688 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a110890b-e657-43a2-b236-6f1b217b0202 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:09.686684 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a110890b-e657-43a2-b236-6f1b217b0202 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:09.687630 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a110890b-e657-43a2-b236-6f1b217b0202 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:09.688227 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a110890b-e657-43a2-b236-6f1b217b0202 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:09.689545 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a110890b-e657-43a2-b236-6f1b217b0202 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:09.690946 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a110890b-e657-43a2-b236-6f1b217b0202 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:09.691959 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a110890b-e657-43a2-b236-6f1b217b0202 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:09.915316 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a110890b-e657-43a2-b236-6f1b217b0202 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:09.937325 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a110890b-e657-43a2-b236-6f1b217b0202 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.268401 Sep 13 01:20:09.941770 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 108/225] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:09 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:10.967316 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-118d5326-12a7-435a-8b32-5ed0cabe7896 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:10.968428 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-118d5326-12a7-435a-8b32-5ed0cabe7896 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:10.971182 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=4 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:10.981027 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-118d5326-12a7-435a-8b32-5ed0cabe7896 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:10.987940 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-118d5326-12a7-435a-8b32-5ed0cabe7896 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:10.988367 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-118d5326-12a7-435a-8b32-5ed0cabe7896 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:10.990673 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-118d5326-12a7-435a-8b32-5ed0cabe7896 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:10.991173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-118d5326-12a7-435a-8b32-5ed0cabe7896 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:10.991609 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-118d5326-12a7-435a-8b32-5ed0cabe7896 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:11.314553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-118d5326-12a7-435a-8b32-5ed0cabe7896 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:11.327965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-118d5326-12a7-435a-8b32-5ed0cabe7896 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.364707 Sep 13 01:20:11.338930 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 118/226] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:10 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:11.876038 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d15abcc2-a6ef-4ee3-ad58-87070570574f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Action: 'create', calling method: .version_select at 0x7fb05e731e50>, body: {"keypair": {"name": "tempest-keypair-1766917123", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIxGJBi4UOYwFM3SDRkc3jl4+B5xRhdzsM7MF0ZrCFd8KofTrXct+M8mARx8yJ2sJuF/PF89HbKQkgcleNSwYMC9DVz2zpLEtzN1yOtha1EMelQDGpVVKwtYgodu3EGxw=="}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:11.909894 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-d15abcc2-a6ef-4ee3-ad58-87070570574f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for project 30ce8239a9b34af685743812ce53ef19. Resources: {'key_pairs'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:20:11.919987 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-d15abcc2-a6ef-4ee3-ad58-87070570574f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for user 776733af5b6a4115b2a11d67666a379d and project 30ce8239a9b34af685743812ce53ef19. Resources: {'key_pairs'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:20:11.955801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d15abcc2-a6ef-4ee3-ad58-87070570574f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.514866 Sep 13 01:20:11.956609 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 109/227] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 01:20:11 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:20:12.366051 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c98ca2b9-8ede-4d9d-a6c4-e703163e2e9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:12.366807 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c98ca2b9-8ede-4d9d-a6c4-e703163e2e9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:12.381221 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c98ca2b9-8ede-4d9d-a6c4-e703163e2e9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:12.384876 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c98ca2b9-8ede-4d9d-a6c4-e703163e2e9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:12.385515 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c98ca2b9-8ede-4d9d-a6c4-e703163e2e9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:12.388099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c98ca2b9-8ede-4d9d-a6c4-e703163e2e9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:12.389505 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c98ca2b9-8ede-4d9d-a6c4-e703163e2e9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:12.391195 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c98ca2b9-8ede-4d9d-a6c4-e703163e2e9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:12.757701 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c98ca2b9-8ede-4d9d-a6c4-e703163e2e9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:12.771168 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c98ca2b9-8ede-4d9d-a6c4-e703163e2e9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1520 microversion: 2.1 time: 0.413413 Sep 13 01:20:12.782180 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 119/228] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:12 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1520 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:13.793921 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4ac05039-ef35-4c72-8ff3-c0b5a1064096 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:13.794537 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4ac05039-ef35-4c72-8ff3-c0b5a1064096 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:13.803699 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4ac05039-ef35-4c72-8ff3-c0b5a1064096 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:13.804476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4ac05039-ef35-4c72-8ff3-c0b5a1064096 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:13.811967 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4ac05039-ef35-4c72-8ff3-c0b5a1064096 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:13.813899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4ac05039-ef35-4c72-8ff3-c0b5a1064096 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:13.814686 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4ac05039-ef35-4c72-8ff3-c0b5a1064096 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:13.815384 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4ac05039-ef35-4c72-8ff3-c0b5a1064096 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:14.507307 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4ac05039-ef35-4c72-8ff3-c0b5a1064096 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:14.518279 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4ac05039-ef35-4c72-8ff3-c0b5a1064096 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1500 microversion: 2.1 time: 0.728364 Sep 13 01:20:14.529286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 110/229] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:13 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1500 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:14.549561 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bfd38df0-a7cc-45e8-a111-1881693b3684 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:14.550183 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bfd38df0-a7cc-45e8-a111-1881693b3684 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:14.571075 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bfd38df0-a7cc-45e8-a111-1881693b3684 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:14.576761 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bfd38df0-a7cc-45e8-a111-1881693b3684 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:14.577233 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bfd38df0-a7cc-45e8-a111-1881693b3684 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:14.584365 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bfd38df0-a7cc-45e8-a111-1881693b3684 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:14.585238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bfd38df0-a7cc-45e8-a111-1881693b3684 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:14.587586 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bfd38df0-a7cc-45e8-a111-1881693b3684 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:14.799710 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2138480708", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed8fe8c3-8c67-4c53-9bb3-c1aeeaaaf18e"}], "security_groups": [{"name": "tempest-securitygroup--131266091"}], "key_name": "tempest-keypair-1766917123", "user_data": "}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:14.922113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bfd38df0-a7cc-45e8-a111-1881693b3684 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:14.931097 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bfd38df0-a7cc-45e8-a111-1881693b3684 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1515 microversion: 2.1 time: 0.392539 Sep 13 01:20:14.936362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 120/230] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:14 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1515 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:14.990078 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.network.neutron [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] validate_networks() for [('ed8fe8c3-8c67-4c53-9bb3-c1aeeaaaf18e', None, None, None, None, None)] {{(pid=120412) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:20:16.181910 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Flavor limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:20:16.182649 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Image limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:20:16.182980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Flavor pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:20:16.184313 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Image pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:20:16.184875 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:20:16.203278 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:16.206790 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:16.208491 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:16.209463 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:16.212116 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:16.212558 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:16.251090 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for project 30ce8239a9b34af685743812ce53ef19. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:20:16.272819 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for user 776733af5b6a4115b2a11d67666a379d and project 30ce8239a9b34af685743812ce53ef19. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:20:16.296524 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Going to run 1 instances... {{(pid=120412) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:20:16.303095 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120412) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:20:16.372235 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a9db3d6a-ff4f-45f9-9ba7-f1d3ae8a0acc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.581625 Sep 13 01:20:16.373328 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 111/231] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:20:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 1583 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 01:20:16.387219 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-01eae4f6-2ed7-4fec-9e4e-b7b7dac73020 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:16.387891 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-01eae4f6-2ed7-4fec-9e4e-b7b7dac73020 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:16.530070 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-01eae4f6-2ed7-4fec-9e4e-b7b7dac73020 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:16.544023 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-01eae4f6-2ed7-4fec-9e4e-b7b7dac73020 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1242 microversion: 2.1 time: 0.161528 Sep 13 01:20:16.544984 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 121/232] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:16 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1242 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:16.734301 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f1f57e4c-8f57-4a38-b564-3de638a00b61 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:16.738351 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-f1f57e4c-8f57-4a38-b564-3de638a00b61 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:16.745071 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f1f57e4c-8f57-4a38-b564-3de638a00b61 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:16.745775 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f1f57e4c-8f57-4a38-b564-3de638a00b61 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:16.746365 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f1f57e4c-8f57-4a38-b564-3de638a00b61 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:16.747287 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f1f57e4c-8f57-4a38-b564-3de638a00b61 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:16.747886 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f1f57e4c-8f57-4a38-b564-3de638a00b61 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:16.748452 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f1f57e4c-8f57-4a38-b564-3de638a00b61 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:16.781509 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-f1f57e4c-8f57-4a38-b564-3de638a00b61 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lazy-loading 'flavor' on Instance uuid 0091ed80-cb3c-4dce-b54c-48989fb19e7b {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:20:16.971217 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f1f57e4c-8f57-4a38-b564-3de638a00b61 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "POST /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b/action" status: 200 len: 32 microversion: 2.1 time: 0.241668 Sep 13 01:20:16.972225 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 112/233] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:20:16 2022] POST /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b/action => generated 32 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 01:20:16.987975 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7010465f-8397-48cf-8868-4c089e046393 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:16.991475 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7010465f-8397-48cf-8868-4c089e046393 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:17.012187 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7010465f-8397-48cf-8868-4c089e046393 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:17.028226 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7010465f-8397-48cf-8868-4c089e046393 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:17.028832 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7010465f-8397-48cf-8868-4c089e046393 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:17.031253 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7010465f-8397-48cf-8868-4c089e046393 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:17.034616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7010465f-8397-48cf-8868-4c089e046393 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:17.035244 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7010465f-8397-48cf-8868-4c089e046393 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:17.284468 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7010465f-8397-48cf-8868-4c089e046393 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:17.295621 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7010465f-8397-48cf-8868-4c089e046393 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.317375 Sep 13 01:20:17.296220 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 122/234] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:16 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:17.570455 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-73908ee5-6b8b-4f2f-9f8c-6310d90502ea tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:17.573777 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-73908ee5-6b8b-4f2f-9f8c-6310d90502ea tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:17.584730 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-73908ee5-6b8b-4f2f-9f8c-6310d90502ea tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:17.587961 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-73908ee5-6b8b-4f2f-9f8c-6310d90502ea tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:17.595305 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-73908ee5-6b8b-4f2f-9f8c-6310d90502ea tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:17.596200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-73908ee5-6b8b-4f2f-9f8c-6310d90502ea tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:17.597074 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-73908ee5-6b8b-4f2f-9f8c-6310d90502ea tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:17.597768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-73908ee5-6b8b-4f2f-9f8c-6310d90502ea tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:17.708838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-73908ee5-6b8b-4f2f-9f8c-6310d90502ea tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:17.720036 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-73908ee5-6b8b-4f2f-9f8c-6310d90502ea tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1294 microversion: 2.1 time: 0.153950 Sep 13 01:20:17.726618 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 113/235] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:17 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1294 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:18.320988 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f7e33b2c-8a01-4004-8bf5-a77651ef05ec tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:18.321663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f7e33b2c-8a01-4004-8bf5-a77651ef05ec tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:18.337099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7e33b2c-8a01-4004-8bf5-a77651ef05ec tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:18.337584 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7e33b2c-8a01-4004-8bf5-a77651ef05ec tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:18.338194 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7e33b2c-8a01-4004-8bf5-a77651ef05ec tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:18.338937 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7e33b2c-8a01-4004-8bf5-a77651ef05ec tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:18.340152 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7e33b2c-8a01-4004-8bf5-a77651ef05ec tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:18.340579 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f7e33b2c-8a01-4004-8bf5-a77651ef05ec tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:18.498877 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f7e33b2c-8a01-4004-8bf5-a77651ef05ec tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:18.509370 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f7e33b2c-8a01-4004-8bf5-a77651ef05ec tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.194372 Sep 13 01:20:18.510622 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 123/236] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:18 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:18.747382 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-cc52dd7a-fdd9-4026-a472-3f402c609fa8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:18.748019 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-cc52dd7a-fdd9-4026-a472-3f402c609fa8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:18.754159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cc52dd7a-fdd9-4026-a472-3f402c609fa8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:18.754652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cc52dd7a-fdd9-4026-a472-3f402c609fa8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:18.755108 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cc52dd7a-fdd9-4026-a472-3f402c609fa8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:18.755811 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cc52dd7a-fdd9-4026-a472-3f402c609fa8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:18.756257 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cc52dd7a-fdd9-4026-a472-3f402c609fa8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:18.756675 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cc52dd7a-fdd9-4026-a472-3f402c609fa8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:18.889735 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-cc52dd7a-fdd9-4026-a472-3f402c609fa8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:18.897236 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-cc52dd7a-fdd9-4026-a472-3f402c609fa8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1300 microversion: 2.1 time: 0.153781 Sep 13 01:20:18.898115 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 114/237] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:18 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1300 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:19.535743 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c6e18dfe-5dc4-4743-a87f-96d651a36c82 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:19.537117 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c6e18dfe-5dc4-4743-a87f-96d651a36c82 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:19.544392 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6e18dfe-5dc4-4743-a87f-96d651a36c82 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:19.545147 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6e18dfe-5dc4-4743-a87f-96d651a36c82 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:19.545802 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6e18dfe-5dc4-4743-a87f-96d651a36c82 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:19.546779 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6e18dfe-5dc4-4743-a87f-96d651a36c82 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:19.547516 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6e18dfe-5dc4-4743-a87f-96d651a36c82 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:19.548174 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6e18dfe-5dc4-4743-a87f-96d651a36c82 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:19.570413 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:19.778279 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c6e18dfe-5dc4-4743-a87f-96d651a36c82 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:19.787068 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c6e18dfe-5dc4-4743-a87f-96d651a36c82 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.256555 Sep 13 01:20:19.788776 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 124/238] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:19 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:19.920996 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-304863ab-e7ff-4f21-941a-402b7053f472 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:19.921605 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-304863ab-e7ff-4f21-941a-402b7053f472 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:19.928465 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-304863ab-e7ff-4f21-941a-402b7053f472 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:19.928970 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-304863ab-e7ff-4f21-941a-402b7053f472 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:19.929457 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-304863ab-e7ff-4f21-941a-402b7053f472 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:19.930158 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-304863ab-e7ff-4f21-941a-402b7053f472 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:19.930882 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-304863ab-e7ff-4f21-941a-402b7053f472 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:19.931500 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-304863ab-e7ff-4f21-941a-402b7053f472 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:19.951523 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:20.449407 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-304863ab-e7ff-4f21-941a-402b7053f472 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:20.462505 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-304863ab-e7ff-4f21-941a-402b7053f472 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1367 microversion: 2.1 time: 0.545269 Sep 13 01:20:20.465037 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 115/239] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:19 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1367 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:20.810803 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a9f5d79f-3548-408e-b320-a030620d9217 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:20.811452 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a9f5d79f-3548-408e-b320-a030620d9217 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:20.830707 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9f5d79f-3548-408e-b320-a030620d9217 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:20.831242 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9f5d79f-3548-408e-b320-a030620d9217 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:20.833413 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9f5d79f-3548-408e-b320-a030620d9217 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:20.834478 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9f5d79f-3548-408e-b320-a030620d9217 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:20.835061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9f5d79f-3548-408e-b320-a030620d9217 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:20.835488 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9f5d79f-3548-408e-b320-a030620d9217 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:20.870161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1260031946", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-758260512", "security_groups": [{"name": "tempest-secgroup-smoke-477650857"}], "networks": [{"uuid": "1634575b-a8d8-4151-84aa-e1e4cfa1c8bc"}], "block_device_mapping_v2": [{"uuid": "f6a3e847-3a0d-45b8-97a9-39d1120736b0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:21.060634 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.network.neutron [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] validate_networks() for [('1634575b-a8d8-4151-84aa-e1e4cfa1c8bc', None, None, None, None, None)] {{(pid=120412) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:20:21.148095 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a9f5d79f-3548-408e-b320-a030620d9217 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:21.162529 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a9f5d79f-3548-408e-b320-a030620d9217 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.356628 Sep 13 01:20:21.163623 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 125/240] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:20 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:21.476395 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-118a3f44-9947-4476-aaca-e996ac23408b req-af3926c0-0d37-4614-9675-76c42abc3220 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f2cc02-f632-47e6-8eae-b39a67ec2bab", "tag": "1ce4a6ed-1a1c-4f8d-acb8-36d90bdf6dbf"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:21.516939 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-118a3f44-9947-4476-aaca-e996ac23408b req-af3926c0-0d37-4614-9675-76c42abc3220 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:21.519256 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-118a3f44-9947-4476-aaca-e996ac23408b req-af3926c0-0d37-4614-9675-76c42abc3220 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:21.520233 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-118a3f44-9947-4476-aaca-e996ac23408b req-af3926c0-0d37-4614-9675-76c42abc3220 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:21.537317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-118a3f44-9947-4476-aaca-e996ac23408b req-af3926c0-0d37-4614-9675-76c42abc3220 service nova] Creating event network-changed:1ce4a6ed-1a1c-4f8d-acb8-36d90bdf6dbf for instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab on hv-cinder-85694 Sep 13 01:20:21.544870 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-118a3f44-9947-4476-aaca-e996ac23408b req-af3926c0-0d37-4614-9675-76c42abc3220 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083501 Sep 13 01:20:21.546014 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 126/241] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:20:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:20:21.555790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c4c8ae3c-5d21-4e5d-8fa1-ee2b8e02ab5f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:21.557207 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c4c8ae3c-5d21-4e5d-8fa1-ee2b8e02ab5f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:21.575747 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4c8ae3c-5d21-4e5d-8fa1-ee2b8e02ab5f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:21.576552 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4c8ae3c-5d21-4e5d-8fa1-ee2b8e02ab5f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:21.577975 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4c8ae3c-5d21-4e5d-8fa1-ee2b8e02ab5f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:21.579820 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4c8ae3c-5d21-4e5d-8fa1-ee2b8e02ab5f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:21.580620 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4c8ae3c-5d21-4e5d-8fa1-ee2b8e02ab5f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:21.581261 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4c8ae3c-5d21-4e5d-8fa1-ee2b8e02ab5f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:21.833809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c4c8ae3c-5d21-4e5d-8fa1-ee2b8e02ab5f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:21.845390 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c4c8ae3c-5d21-4e5d-8fa1-ee2b8e02ab5f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1367 microversion: 2.1 time: 0.297091 Sep 13 01:20:21.863134 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 127/242] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:21 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1367 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:22.126504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Flavor limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:20:22.128961 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Image limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:20:22.129699 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Flavor pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:20:22.130910 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Image pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:20:22.131680 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:20:22.142550 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:22.143220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:22.143719 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:22.144558 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:22.145021 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:22.145663 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:22.166972 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Getting quotas for project de31bd722d4f419d9269b519af7f793a. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:20:22.172793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Getting quotas for user 85178dc2280c4a54970fc207d1746608 and project de31bd722d4f419d9269b519af7f793a. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:20:22.190570 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7ee29925-6834-4452-a8da-78e4554e9a1a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:22.191523 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7ee29925-6834-4452-a8da-78e4554e9a1a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:22.201275 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ee29925-6834-4452-a8da-78e4554e9a1a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:22.204030 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ee29925-6834-4452-a8da-78e4554e9a1a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:22.204530 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ee29925-6834-4452-a8da-78e4554e9a1a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:22.206836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ee29925-6834-4452-a8da-78e4554e9a1a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:22.207788 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ee29925-6834-4452-a8da-78e4554e9a1a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:22.209523 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ee29925-6834-4452-a8da-78e4554e9a1a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:22.243605 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Going to run 1 instances... {{(pid=120412) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:20:22.246212 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f6a3e847-3a0d-45b8-97a9-39d1120736b0',volume_size=None,volume_type=None)] {{(pid=120412) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:20:22.449531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-2f474ec1-350e-41d1-84c8-06627dd7f9de tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.584347 Sep 13 01:20:22.450478 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 116/243] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:20:20 2022] POST /compute/v2.1/servers => generated 405 bytes in 1587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 01:20:22.465412 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-640364de-cab4-4c66-a734-c8501d54df14 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:22.466290 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-640364de-cab4-4c66-a734-c8501d54df14 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:22.611338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-640364de-cab4-4c66-a734-c8501d54df14 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:22.619999 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-640364de-cab4-4c66-a734-c8501d54df14 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1088 microversion: 2.1 time: 0.159058 Sep 13 01:20:22.624610 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7ee29925-6834-4452-a8da-78e4554e9a1a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:22.634318 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7ee29925-6834-4452-a8da-78e4554e9a1a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.448750 Sep 13 01:20:22.636982 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 117/244] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:22 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1088 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:22.637667 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 128/245] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:22 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:22.870001 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-430765f8-c7b8-49be-b37c-139bda992a74 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:22.871509 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-430765f8-c7b8-49be-b37c-139bda992a74 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:22.879591 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-430765f8-c7b8-49be-b37c-139bda992a74 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:22.880425 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-430765f8-c7b8-49be-b37c-139bda992a74 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:22.881208 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-430765f8-c7b8-49be-b37c-139bda992a74 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:22.882264 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-430765f8-c7b8-49be-b37c-139bda992a74 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:22.883016 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-430765f8-c7b8-49be-b37c-139bda992a74 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:22.898710 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-430765f8-c7b8-49be-b37c-139bda992a74 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:23.154887 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-430765f8-c7b8-49be-b37c-139bda992a74 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:23.173145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-430765f8-c7b8-49be-b37c-139bda992a74 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1367 microversion: 2.1 time: 0.304250 Sep 13 01:20:23.173800 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 118/246] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:22 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1367 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:23.648285 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7ca1cced-7667-48af-a8be-62becbdab587 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:23.649524 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7ca1cced-7667-48af-a8be-62becbdab587 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:23.664633 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-98fb46ee-e37f-4352-a78d-8771d7bf16b8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:23.665442 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-98fb46ee-e37f-4352-a78d-8771d7bf16b8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:23.674471 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca1cced-7667-48af-a8be-62becbdab587 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:23.675834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca1cced-7667-48af-a8be-62becbdab587 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:23.676524 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca1cced-7667-48af-a8be-62becbdab587 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:23.678076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca1cced-7667-48af-a8be-62becbdab587 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:23.679024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca1cced-7667-48af-a8be-62becbdab587 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:23.679776 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca1cced-7667-48af-a8be-62becbdab587 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:23.684287 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-98fb46ee-e37f-4352-a78d-8771d7bf16b8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:23.684735 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-98fb46ee-e37f-4352-a78d-8771d7bf16b8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:23.685181 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-98fb46ee-e37f-4352-a78d-8771d7bf16b8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:23.686157 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-98fb46ee-e37f-4352-a78d-8771d7bf16b8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:23.686618 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-98fb46ee-e37f-4352-a78d-8771d7bf16b8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:23.687088 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-98fb46ee-e37f-4352-a78d-8771d7bf16b8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:23.926932 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7ca1cced-7667-48af-a8be-62becbdab587 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:23.949495 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7ca1cced-7667-48af-a8be-62becbdab587 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1130 microversion: 2.1 time: 0.309261 Sep 13 01:20:23.962700 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 129/247] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:23 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1130 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:24.067401 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-98fb46ee-e37f-4352-a78d-8771d7bf16b8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:24.078738 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-98fb46ee-e37f-4352-a78d-8771d7bf16b8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.418566 Sep 13 01:20:24.094970 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 119/248] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:23 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:24.200520 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-dfdfd2eb-b1bf-4864-9d6a-0ac2d6840f3d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:24.201247 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-dfdfd2eb-b1bf-4864-9d6a-0ac2d6840f3d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:24.212510 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dfdfd2eb-b1bf-4864-9d6a-0ac2d6840f3d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:24.213007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dfdfd2eb-b1bf-4864-9d6a-0ac2d6840f3d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:24.213800 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dfdfd2eb-b1bf-4864-9d6a-0ac2d6840f3d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:24.216598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dfdfd2eb-b1bf-4864-9d6a-0ac2d6840f3d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:24.218717 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dfdfd2eb-b1bf-4864-9d6a-0ac2d6840f3d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:24.219342 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dfdfd2eb-b1bf-4864-9d6a-0ac2d6840f3d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:24.517477 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-dfdfd2eb-b1bf-4864-9d6a-0ac2d6840f3d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:24.525832 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-dfdfd2eb-b1bf-4864-9d6a-0ac2d6840f3d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1367 microversion: 2.1 time: 0.331448 Sep 13 01:20:24.530903 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 130/249] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:24 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:24.977513 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-6e577e8b-bb47-4f93-a26c-44c45889621d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:24.978186 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-6e577e8b-bb47-4f93-a26c-44c45889621d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:24.985826 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6e577e8b-bb47-4f93-a26c-44c45889621d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:24.986300 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6e577e8b-bb47-4f93-a26c-44c45889621d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:24.986760 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6e577e8b-bb47-4f93-a26c-44c45889621d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:24.987504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6e577e8b-bb47-4f93-a26c-44c45889621d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:24.987955 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6e577e8b-bb47-4f93-a26c-44c45889621d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:24.988534 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6e577e8b-bb47-4f93-a26c-44c45889621d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:25.060676 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6e577e8b-bb47-4f93-a26c-44c45889621d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:25.068940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-6e577e8b-bb47-4f93-a26c-44c45889621d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1186 microversion: 2.1 time: 0.095207 Sep 13 01:20:25.069766 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 120/250] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:24 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1186 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:25.108052 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0acf4b78-0c4c-4c2f-8c1f-c67d656c258f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:25.108673 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0acf4b78-0c4c-4c2f-8c1f-c67d656c258f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:25.115116 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0acf4b78-0c4c-4c2f-8c1f-c67d656c258f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:25.115799 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0acf4b78-0c4c-4c2f-8c1f-c67d656c258f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:25.116750 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0acf4b78-0c4c-4c2f-8c1f-c67d656c258f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:25.117717 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0acf4b78-0c4c-4c2f-8c1f-c67d656c258f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:25.118190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0acf4b78-0c4c-4c2f-8c1f-c67d656c258f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:25.118921 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0acf4b78-0c4c-4c2f-8c1f-c67d656c258f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:25.262782 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0acf4b78-0c4c-4c2f-8c1f-c67d656c258f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:25.271417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0acf4b78-0c4c-4c2f-8c1f-c67d656c258f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.167259 Sep 13 01:20:25.272322 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 131/251] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:25 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:25.555705 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c5754062-f791-4b2b-ae11-2074882cf16f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:25.556870 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c5754062-f791-4b2b-ae11-2074882cf16f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:25.565537 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c5754062-f791-4b2b-ae11-2074882cf16f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:25.566040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c5754062-f791-4b2b-ae11-2074882cf16f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:25.566480 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c5754062-f791-4b2b-ae11-2074882cf16f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:25.567507 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c5754062-f791-4b2b-ae11-2074882cf16f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:25.568272 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c5754062-f791-4b2b-ae11-2074882cf16f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:25.568863 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c5754062-f791-4b2b-ae11-2074882cf16f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:25.794041 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c5754062-f791-4b2b-ae11-2074882cf16f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:25.802644 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c5754062-f791-4b2b-ae11-2074882cf16f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1367 microversion: 2.1 time: 0.252474 Sep 13 01:20:25.813262 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 121/252] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:25 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:26.092389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-831a30f3-0dc8-472a-93e3-5a431ddcc64a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:26.093013 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-831a30f3-0dc8-472a-93e3-5a431ddcc64a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:26.099113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-831a30f3-0dc8-472a-93e3-5a431ddcc64a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:26.099976 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-831a30f3-0dc8-472a-93e3-5a431ddcc64a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:26.100510 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-831a30f3-0dc8-472a-93e3-5a431ddcc64a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:26.101472 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-831a30f3-0dc8-472a-93e3-5a431ddcc64a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:26.102169 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-831a30f3-0dc8-472a-93e3-5a431ddcc64a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:26.102916 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-831a30f3-0dc8-472a-93e3-5a431ddcc64a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:26.180525 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-831a30f3-0dc8-472a-93e3-5a431ddcc64a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:26.187054 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-df8af34c-99b9-40fa-bfd2-a84ad0accb04 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:26.187547 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-df8af34c-99b9-40fa-bfd2-a84ad0accb04 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:26.191210 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-831a30f3-0dc8-472a-93e3-5a431ddcc64a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1186 microversion: 2.1 time: 0.103300 Sep 13 01:20:26.192317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 132/253] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:26 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1186 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:26.194710 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-df8af34c-99b9-40fa-bfd2-a84ad0accb04 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:26.195225 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-df8af34c-99b9-40fa-bfd2-a84ad0accb04 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:26.195653 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-df8af34c-99b9-40fa-bfd2-a84ad0accb04 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:26.199716 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-df8af34c-99b9-40fa-bfd2-a84ad0accb04 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:26.200184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-df8af34c-99b9-40fa-bfd2-a84ad0accb04 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:26.200611 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-df8af34c-99b9-40fa-bfd2-a84ad0accb04 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:26.234189 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-df8af34c-99b9-40fa-bfd2-a84ad0accb04 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/ips" status: 200 len: 145 microversion: 2.1 time: 0.051556 Sep 13 01:20:26.234919 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 122/254] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 01:20:26 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/ips => generated 145 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:20:26.294117 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-456b84a8-8f37-4b91-acfa-5857def1138c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:26.294761 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-456b84a8-8f37-4b91-acfa-5857def1138c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:26.301286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-456b84a8-8f37-4b91-acfa-5857def1138c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:26.301688 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-456b84a8-8f37-4b91-acfa-5857def1138c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:26.302339 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-456b84a8-8f37-4b91-acfa-5857def1138c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:26.303475 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-456b84a8-8f37-4b91-acfa-5857def1138c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:26.304105 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-456b84a8-8f37-4b91-acfa-5857def1138c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:26.304552 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-456b84a8-8f37-4b91-acfa-5857def1138c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:26.408873 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-383ec9ac-117c-4a3e-b2b6-fe3a1021a2e9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:26.409949 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-383ec9ac-117c-4a3e-b2b6-fe3a1021a2e9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:26.423016 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-383ec9ac-117c-4a3e-b2b6-fe3a1021a2e9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:26.424075 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-383ec9ac-117c-4a3e-b2b6-fe3a1021a2e9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:26.425385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-383ec9ac-117c-4a3e-b2b6-fe3a1021a2e9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:26.426690 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-383ec9ac-117c-4a3e-b2b6-fe3a1021a2e9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:26.429787 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-383ec9ac-117c-4a3e-b2b6-fe3a1021a2e9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:26.431521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-383ec9ac-117c-4a3e-b2b6-fe3a1021a2e9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:26.460625 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-383ec9ac-117c-4a3e-b2b6-fe3a1021a2e9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/ips" status: 200 len: 151 microversion: 2.20 time: 0.055568 Sep 13 01:20:26.463135 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 123/255] 10.222.0.15 () {60 vars in 1289 bytes} [Tue Sep 13 01:20:26 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/ips => generated 151 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 13 01:20:26.503961 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-456b84a8-8f37-4b91-acfa-5857def1138c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:26.515104 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-456b84a8-8f37-4b91-acfa-5857def1138c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.224871 Sep 13 01:20:26.515909 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 133/256] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:26 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:26.827911 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7d7eb520-7da5-47f6-b5b0-7f42aa52df2c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:26.828774 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7d7eb520-7da5-47f6-b5b0-7f42aa52df2c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:26.836999 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d7eb520-7da5-47f6-b5b0-7f42aa52df2c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:26.837940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d7eb520-7da5-47f6-b5b0-7f42aa52df2c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:26.838572 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d7eb520-7da5-47f6-b5b0-7f42aa52df2c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:26.839694 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d7eb520-7da5-47f6-b5b0-7f42aa52df2c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:26.840535 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d7eb520-7da5-47f6-b5b0-7f42aa52df2c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:26.842189 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d7eb520-7da5-47f6-b5b0-7f42aa52df2c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:27.115819 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7d7eb520-7da5-47f6-b5b0-7f42aa52df2c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:27.124826 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7d7eb520-7da5-47f6-b5b0-7f42aa52df2c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1367 microversion: 2.1 time: 0.301386 Sep 13 01:20:27.126071 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 124/257] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:26 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:27.217333 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:27.221791 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-69f4a8c0-383e-49e6-b68d-1628d86e021f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:27.222415 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-69f4a8c0-383e-49e6-b68d-1628d86e021f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:27.230754 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-69f4a8c0-383e-49e6-b68d-1628d86e021f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:27.233099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-69f4a8c0-383e-49e6-b68d-1628d86e021f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:27.233721 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-69f4a8c0-383e-49e6-b68d-1628d86e021f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:27.235607 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-69f4a8c0-383e-49e6-b68d-1628d86e021f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:27.236237 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-69f4a8c0-383e-49e6-b68d-1628d86e021f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:27.237882 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-69f4a8c0-383e-49e6-b68d-1628d86e021f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:27.362155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-69f4a8c0-383e-49e6-b68d-1628d86e021f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:27.374464 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-69f4a8c0-383e-49e6-b68d-1628d86e021f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1186 microversion: 2.1 time: 0.157672 Sep 13 01:20:27.386918 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 134/258] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:27 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1186 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:27.543618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0c8be83b-d3ed-4261-9767-80776edbdd5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:27.544240 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0c8be83b-d3ed-4261-9767-80776edbdd5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:27.551674 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c8be83b-d3ed-4261-9767-80776edbdd5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:27.552397 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c8be83b-d3ed-4261-9767-80776edbdd5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:27.553032 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c8be83b-d3ed-4261-9767-80776edbdd5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:27.554153 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c8be83b-d3ed-4261-9767-80776edbdd5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:27.554820 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c8be83b-d3ed-4261-9767-80776edbdd5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:27.556055 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c8be83b-d3ed-4261-9767-80776edbdd5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:27.752648 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0c8be83b-d3ed-4261-9767-80776edbdd5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:27.755811 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c88e3c8d-198e-499f-a33f-ac1cb64a345a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Action: 'create', calling method: .version_select at 0x7fb05e617ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1305807284", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKFZrezOysG/m6w6uQUi/MUdOWZlgk//c+fqAYznL8Zv5PN0FLyGJ/qKHHShpCesml/xezSgbZpVdpykjmNVimHrazFcZs6LjpSlekuqnBLSJsDCbjgNGrUS6fEuQqykDA=="}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:27.763021 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0c8be83b-d3ed-4261-9767-80776edbdd5c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.223750 Sep 13 01:20:27.764123 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 135/259] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:27 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:27.787925 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-c88e3c8d-198e-499f-a33f-ac1cb64a345a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Getting quotas for project 66cdd4ec03ea4fbf959ede65bb96f6ca. Resources: {'key_pairs'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:20:27.793137 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-c88e3c8d-198e-499f-a33f-ac1cb64a345a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Getting quotas for user 2842b222fe6b4821a670d13ec8febf1a and project 66cdd4ec03ea4fbf959ede65bb96f6ca. Resources: {'key_pairs'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:20:27.819968 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c88e3c8d-198e-499f-a33f-ac1cb64a345a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.390330 Sep 13 01:20:27.820573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 125/260] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 01:20:27 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:20:28.156370 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c84cc344-6c80-47e1-84ab-d70304e6f427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:28.156990 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c84cc344-6c80-47e1-84ab-d70304e6f427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:28.177307 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c84cc344-6c80-47e1-84ab-d70304e6f427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:28.177871 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c84cc344-6c80-47e1-84ab-d70304e6f427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:28.178958 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c84cc344-6c80-47e1-84ab-d70304e6f427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:28.179855 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c84cc344-6c80-47e1-84ab-d70304e6f427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:28.181193 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c84cc344-6c80-47e1-84ab-d70304e6f427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:28.181724 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c84cc344-6c80-47e1-84ab-d70304e6f427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:28.408880 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b2c81c1a-f17b-4dc8-9262-0f6d2555e67d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:28.409618 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b2c81c1a-f17b-4dc8-9262-0f6d2555e67d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:28.420677 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b2c81c1a-f17b-4dc8-9262-0f6d2555e67d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:28.421297 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b2c81c1a-f17b-4dc8-9262-0f6d2555e67d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:28.421905 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b2c81c1a-f17b-4dc8-9262-0f6d2555e67d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:28.424890 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b2c81c1a-f17b-4dc8-9262-0f6d2555e67d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:28.426294 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b2c81c1a-f17b-4dc8-9262-0f6d2555e67d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:28.428008 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b2c81c1a-f17b-4dc8-9262-0f6d2555e67d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:28.780622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b2c81c1a-f17b-4dc8-9262-0f6d2555e67d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:28.795882 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b2c81c1a-f17b-4dc8-9262-0f6d2555e67d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1271 microversion: 2.1 time: 0.397069 Sep 13 01:20:28.800326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 126/261] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:28 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1271 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:28.808471 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-ca6cc34f-a8b5-45af-80f8-61eff23a59ac req-bf90089d-fc7f-437b-99b8-4564588a2faa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f2cc02-f632-47e6-8eae-b39a67ec2bab", "name": "network-vif-plugged", "status": "completed", "tag": "1ce4a6ed-1a1c-4f8d-acb8-36d90bdf6dbf"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:28.823412 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-ca6cc34f-a8b5-45af-80f8-61eff23a59ac req-bf90089d-fc7f-437b-99b8-4564588a2faa service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:28.823939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-ca6cc34f-a8b5-45af-80f8-61eff23a59ac req-bf90089d-fc7f-437b-99b8-4564588a2faa service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:28.824326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-ca6cc34f-a8b5-45af-80f8-61eff23a59ac req-bf90089d-fc7f-437b-99b8-4564588a2faa service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:28.863779 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-ca6cc34f-a8b5-45af-80f8-61eff23a59ac req-bf90089d-fc7f-437b-99b8-4564588a2faa service nova] Creating event network-vif-plugged:1ce4a6ed-1a1c-4f8d-acb8-36d90bdf6dbf for instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab on hv-cinder-85694 Sep 13 01:20:28.881535 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-ca6cc34f-a8b5-45af-80f8-61eff23a59ac req-bf90089d-fc7f-437b-99b8-4564588a2faa service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078115 Sep 13 01:20:28.882254 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 127/262] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:20:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:20:28.903556 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-cdeda2ca-db22-42bf-889c-9e98aaa1bd34 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:28.904637 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-cdeda2ca-db22-42bf-889c-9e98aaa1bd34 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:28.922823 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cdeda2ca-db22-42bf-889c-9e98aaa1bd34 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:28.923385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cdeda2ca-db22-42bf-889c-9e98aaa1bd34 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:28.923890 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cdeda2ca-db22-42bf-889c-9e98aaa1bd34 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:28.924664 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cdeda2ca-db22-42bf-889c-9e98aaa1bd34 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:28.925218 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cdeda2ca-db22-42bf-889c-9e98aaa1bd34 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:28.925672 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cdeda2ca-db22-42bf-889c-9e98aaa1bd34 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:28.945991 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c84cc344-6c80-47e1-84ab-d70304e6f427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:28.957109 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c84cc344-6c80-47e1-84ab-d70304e6f427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1367 microversion: 2.1 time: 0.811085 Sep 13 01:20:28.970707 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 136/263] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:28 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1367 bytes in 812 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:29.030679 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1044fc64-87f1-44d4-8e0c-c0f4b07b8d13 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:29.031265 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1044fc64-87f1-44d4-8e0c-c0f4b07b8d13 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:29.040600 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1044fc64-87f1-44d4-8e0c-c0f4b07b8d13 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:29.041010 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1044fc64-87f1-44d4-8e0c-c0f4b07b8d13 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:29.041501 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1044fc64-87f1-44d4-8e0c-c0f4b07b8d13 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:29.042436 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1044fc64-87f1-44d4-8e0c-c0f4b07b8d13 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:29.048230 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1044fc64-87f1-44d4-8e0c-c0f4b07b8d13 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:29.050781 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1044fc64-87f1-44d4-8e0c-c0f4b07b8d13 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:29.111792 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-1044fc64-87f1-44d4-8e0c-c0f4b07b8d13 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lazy-loading 'flavor' on Instance uuid 1677b90a-17f0-496f-8fce-ac573509c1ac {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:20:29.473225 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1044fc64-87f1-44d4-8e0c-c0f4b07b8d13 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "POST /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/action" status: 202 len: 0 microversion: 2.20 time: 0.452534 Sep 13 01:20:29.474271 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 137/264] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Sep 13 01:20:29 2022] POST /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 13 01:20:29.482789 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8893acc2-3716-405f-8321-1e294aadf4fe tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:29.483633 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8893acc2-3716-405f-8321-1e294aadf4fe tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:29.503587 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-cdeda2ca-db22-42bf-889c-9e98aaa1bd34 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:29.515385 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8893acc2-3716-405f-8321-1e294aadf4fe tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:29.516570 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-cdeda2ca-db22-42bf-889c-9e98aaa1bd34 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.632795 Sep 13 01:20:29.517213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8893acc2-3716-405f-8321-1e294aadf4fe tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:29.517782 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8893acc2-3716-405f-8321-1e294aadf4fe tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:29.519888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 128/265] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:28 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:29.519989 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8893acc2-3716-405f-8321-1e294aadf4fe tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:29.521002 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8893acc2-3716-405f-8321-1e294aadf4fe tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:29.521687 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8893acc2-3716-405f-8321-1e294aadf4fe tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:29.593698 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-fe471b52-c093-4379-87c3-5f7eb227c50b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44f3fcea-07c1-4a07-bd3c-4c4a6be49a3e"}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:29.596122 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-fe471b52-c093-4379-87c3-5f7eb227c50b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:29.613460 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fe471b52-c093-4379-87c3-5f7eb227c50b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:29.614428 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fe471b52-c093-4379-87c3-5f7eb227c50b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:29.615201 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fe471b52-c093-4379-87c3-5f7eb227c50b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:29.616448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fe471b52-c093-4379-87c3-5f7eb227c50b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:29.616978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fe471b52-c093-4379-87c3-5f7eb227c50b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:29.617659 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fe471b52-c093-4379-87c3-5f7eb227c50b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:29.843499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8893acc2-3716-405f-8321-1e294aadf4fe tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:29.862108 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8893acc2-3716-405f-8321-1e294aadf4fe tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:29.863791 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8893acc2-3716-405f-8321-1e294aadf4fe tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:29.865092 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8893acc2-3716-405f-8321-1e294aadf4fe tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.386641 Sep 13 01:20:29.887396 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 138/266] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:29 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:20:29.894795 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1f1eab79-9573-47c7-8076-50bf80ac9136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:29.895557 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1f1eab79-9573-47c7-8076-50bf80ac9136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:29.903846 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f1eab79-9573-47c7-8076-50bf80ac9136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:29.904628 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f1eab79-9573-47c7-8076-50bf80ac9136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:29.905298 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f1eab79-9573-47c7-8076-50bf80ac9136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:29.906447 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f1eab79-9573-47c7-8076-50bf80ac9136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:29.907428 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f1eab79-9573-47c7-8076-50bf80ac9136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:29.908199 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f1eab79-9573-47c7-8076-50bf80ac9136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:30.088582 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1f1eab79-9573-47c7-8076-50bf80ac9136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:30.096563 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:30.100172 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1f1eab79-9573-47c7-8076-50bf80ac9136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.211577 Sep 13 01:20:30.100920 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 139/267] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:29 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:30.105529 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-65752ee1-4045-49e7-91e5-1298dacb591e req-4e1d5f0e-f23f-4755-b96a-5233feb56179 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf5279a7-4859-458b-958c-85fd71cb4d72", "tag": "c4858902-df62-4017-b106-503915275745"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:30.132955 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-65752ee1-4045-49e7-91e5-1298dacb591e req-4e1d5f0e-f23f-4755-b96a-5233feb56179 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:30.133441 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-65752ee1-4045-49e7-91e5-1298dacb591e req-4e1d5f0e-f23f-4755-b96a-5233feb56179 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:30.133905 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-65752ee1-4045-49e7-91e5-1298dacb591e req-4e1d5f0e-f23f-4755-b96a-5233feb56179 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:30.146070 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-65752ee1-4045-49e7-91e5-1298dacb591e req-4e1d5f0e-f23f-4755-b96a-5233feb56179 service nova] Creating event network-changed:c4858902-df62-4017-b106-503915275745 for instance cf5279a7-4859-458b-958c-85fd71cb4d72 on hv-cinder-85694 Sep 13 01:20:30.151209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-65752ee1-4045-49e7-91e5-1298dacb591e req-4e1d5f0e-f23f-4755-b96a-5233feb56179 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049022 Sep 13 01:20:30.152365 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 140/268] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:20:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:20:30.157222 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f6d89958-165a-434d-8ed5-bc92dc215cba tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:30.157915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f6d89958-165a-434d-8ed5-bc92dc215cba tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:30.163927 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f6d89958-165a-434d-8ed5-bc92dc215cba tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:30.164412 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f6d89958-165a-434d-8ed5-bc92dc215cba tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:30.164851 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f6d89958-165a-434d-8ed5-bc92dc215cba tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:30.165541 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f6d89958-165a-434d-8ed5-bc92dc215cba tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:30.165996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f6d89958-165a-434d-8ed5-bc92dc215cba tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:30.166416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f6d89958-165a-434d-8ed5-bc92dc215cba tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:30.331114 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f6d89958-165a-434d-8ed5-bc92dc215cba tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:30.331114 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f6d89958-165a-434d-8ed5-bc92dc215cba tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1367 microversion: 2.1 time: 0.176083 Sep 13 01:20:30.331114 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 141/269] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:30 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:30.546604 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c3251004-0c55-412f-a139-17e7d4b399f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:30.547750 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c3251004-0c55-412f-a139-17e7d4b399f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:30.555500 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3251004-0c55-412f-a139-17e7d4b399f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:30.555998 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3251004-0c55-412f-a139-17e7d4b399f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:30.556443 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3251004-0c55-412f-a139-17e7d4b399f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:30.557154 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3251004-0c55-412f-a139-17e7d4b399f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:30.558412 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3251004-0c55-412f-a139-17e7d4b399f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:30.558872 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3251004-0c55-412f-a139-17e7d4b399f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:30.734575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c3251004-0c55-412f-a139-17e7d4b399f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:30.742821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c3251004-0c55-412f-a139-17e7d4b399f9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.200503 Sep 13 01:20:30.743597 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 142/270] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:30 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:30.875168 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-fe471b52-c093-4379-87c3-5f7eb227c50b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "POST /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.286486 Sep 13 01:20:30.876339 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 129/271] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:20:29 2022] POST /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/os-volume_attachments => generated 194 bytes in 1289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:20:30.894075 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7b7a7522-85ae-4c6c-a2ae-c2983fa6b617 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:30.894723 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7b7a7522-85ae-4c6c-a2ae-c2983fa6b617 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:30.901170 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b7a7522-85ae-4c6c-a2ae-c2983fa6b617 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:30.902008 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b7a7522-85ae-4c6c-a2ae-c2983fa6b617 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:30.902685 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b7a7522-85ae-4c6c-a2ae-c2983fa6b617 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:30.903626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b7a7522-85ae-4c6c-a2ae-c2983fa6b617 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:30.904279 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b7a7522-85ae-4c6c-a2ae-c2983fa6b617 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:30.904720 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7b7a7522-85ae-4c6c-a2ae-c2983fa6b617 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:31.050215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7b7a7522-85ae-4c6c-a2ae-c2983fa6b617 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:31.058876 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7b7a7522-85ae-4c6c-a2ae-c2983fa6b617 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:31.060620 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7b7a7522-85ae-4c6c-a2ae-c2983fa6b617 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:31.061817 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7b7a7522-85ae-4c6c-a2ae-c2983fa6b617 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.171738 Sep 13 01:20:31.062371 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 143/272] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:30 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:31.129013 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a085ecc0-7370-470e-99e5-0d4f2b7e5e04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:31.129769 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a085ecc0-7370-470e-99e5-0d4f2b7e5e04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:31.133863 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:31.138707 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a085ecc0-7370-470e-99e5-0d4f2b7e5e04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:31.139442 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a085ecc0-7370-470e-99e5-0d4f2b7e5e04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:31.139857 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a085ecc0-7370-470e-99e5-0d4f2b7e5e04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:31.140631 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a085ecc0-7370-470e-99e5-0d4f2b7e5e04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:31.141026 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a085ecc0-7370-470e-99e5-0d4f2b7e5e04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:31.141498 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a085ecc0-7370-470e-99e5-0d4f2b7e5e04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:31.355254 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-301efcbd-6b2d-45bf-b419-22f6be510bbd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:31.356638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-301efcbd-6b2d-45bf-b419-22f6be510bbd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:31.364480 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-301efcbd-6b2d-45bf-b419-22f6be510bbd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:31.365190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-301efcbd-6b2d-45bf-b419-22f6be510bbd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:31.365808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-301efcbd-6b2d-45bf-b419-22f6be510bbd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:31.366661 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-301efcbd-6b2d-45bf-b419-22f6be510bbd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:31.367505 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-301efcbd-6b2d-45bf-b419-22f6be510bbd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:31.368078 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-301efcbd-6b2d-45bf-b419-22f6be510bbd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:31.378143 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a085ecc0-7370-470e-99e5-0d4f2b7e5e04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:31.386373 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a085ecc0-7370-470e-99e5-0d4f2b7e5e04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.261858 Sep 13 01:20:31.386985 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 130/273] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:31 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:31.513458 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-301efcbd-6b2d-45bf-b419-22f6be510bbd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:31.525657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-301efcbd-6b2d-45bf-b419-22f6be510bbd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1367 microversion: 2.1 time: 0.174378 Sep 13 01:20:31.527126 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 144/274] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:31 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1367 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:31.770236 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7e6d6b59-028c-44fc-a2b7-e964707d199f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:31.771172 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7e6d6b59-028c-44fc-a2b7-e964707d199f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:31.778884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e6d6b59-028c-44fc-a2b7-e964707d199f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:31.779385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e6d6b59-028c-44fc-a2b7-e964707d199f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:31.779864 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e6d6b59-028c-44fc-a2b7-e964707d199f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:31.780579 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e6d6b59-028c-44fc-a2b7-e964707d199f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:31.781033 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e6d6b59-028c-44fc-a2b7-e964707d199f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:31.781584 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e6d6b59-028c-44fc-a2b7-e964707d199f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:31.924386 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7e6d6b59-028c-44fc-a2b7-e964707d199f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:31.936140 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7e6d6b59-028c-44fc-a2b7-e964707d199f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.170144 Sep 13 01:20:31.936742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 131/275] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:31 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:32.087986 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e9681894-87f9-4b76-8748-7294de5b2445 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:32.088593 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e9681894-87f9-4b76-8748-7294de5b2445 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:32.095619 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9681894-87f9-4b76-8748-7294de5b2445 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:32.096108 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9681894-87f9-4b76-8748-7294de5b2445 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:32.096544 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9681894-87f9-4b76-8748-7294de5b2445 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:32.097246 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9681894-87f9-4b76-8748-7294de5b2445 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:32.097701 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9681894-87f9-4b76-8748-7294de5b2445 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:32.098124 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9681894-87f9-4b76-8748-7294de5b2445 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:32.231403 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e9681894-87f9-4b76-8748-7294de5b2445 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:32.244889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e9681894-87f9-4b76-8748-7294de5b2445 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:32.247137 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e9681894-87f9-4b76-8748-7294de5b2445 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:32.248402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e9681894-87f9-4b76-8748-7294de5b2445 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.164712 Sep 13 01:20:32.248968 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 145/276] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:32 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:32.409894 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-23e8b692-47f4-448c-86be-51e07bda85d5 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:32.410783 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-23e8b692-47f4-448c-86be-51e07bda85d5 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:32.417357 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=4 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:32.421399 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-23e8b692-47f4-448c-86be-51e07bda85d5 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:32.421885 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-23e8b692-47f4-448c-86be-51e07bda85d5 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:32.422316 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-23e8b692-47f4-448c-86be-51e07bda85d5 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:32.423038 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-23e8b692-47f4-448c-86be-51e07bda85d5 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:32.423491 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-23e8b692-47f4-448c-86be-51e07bda85d5 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:32.423916 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-23e8b692-47f4-448c-86be-51e07bda85d5 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:32.552346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4fb07258-6fe3-4b6d-be59-547307aecbdd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:32.553865 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4fb07258-6fe3-4b6d-be59-547307aecbdd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:32.576828 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=66 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:32.592204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4fb07258-6fe3-4b6d-be59-547307aecbdd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:32.592704 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4fb07258-6fe3-4b6d-be59-547307aecbdd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:32.593140 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4fb07258-6fe3-4b6d-be59-547307aecbdd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:32.593853 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4fb07258-6fe3-4b6d-be59-547307aecbdd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:32.594302 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4fb07258-6fe3-4b6d-be59-547307aecbdd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:32.600080 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4fb07258-6fe3-4b6d-be59-547307aecbdd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:32.773781 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4fb07258-6fe3-4b6d-be59-547307aecbdd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:32.783793 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4fb07258-6fe3-4b6d-be59-547307aecbdd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1558 microversion: 2.1 time: 0.235744 Sep 13 01:20:32.784960 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 146/277] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:32 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1558 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:32.807241 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-dccd3787-e8e8-492c-9cba-d0b9e9e47bf6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:32.808709 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-dccd3787-e8e8-492c-9cba-d0b9e9e47bf6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:32.816304 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dccd3787-e8e8-492c-9cba-d0b9e9e47bf6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:32.817104 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dccd3787-e8e8-492c-9cba-d0b9e9e47bf6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:32.817757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dccd3787-e8e8-492c-9cba-d0b9e9e47bf6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:32.818873 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dccd3787-e8e8-492c-9cba-d0b9e9e47bf6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:32.819526 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dccd3787-e8e8-492c-9cba-d0b9e9e47bf6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:32.820142 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-dccd3787-e8e8-492c-9cba-d0b9e9e47bf6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:32.932720 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-dccd3787-e8e8-492c-9cba-d0b9e9e47bf6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129366 Sep 13 01:20:32.940923 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 147/278] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 01:20:32 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:20:32.960439 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ee0f0d52-f341-440c-9948-341924b8676c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:32.961058 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ee0f0d52-f341-440c-9948-341924b8676c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:32.982191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee0f0d52-f341-440c-9948-341924b8676c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:32.982699 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee0f0d52-f341-440c-9948-341924b8676c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:32.983168 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee0f0d52-f341-440c-9948-341924b8676c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:32.983893 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee0f0d52-f341-440c-9948-341924b8676c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:32.984350 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee0f0d52-f341-440c-9948-341924b8676c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:32.984776 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ee0f0d52-f341-440c-9948-341924b8676c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:33.076800 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-23e8b692-47f4-448c-86be-51e07bda85d5 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:33.089375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-23e8b692-47f4-448c-86be-51e07bda85d5 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.682552 Sep 13 01:20:33.091273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 132/279] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:32 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:33.277111 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-6e3bd191-2f16-4820-a812-362d6d938f48 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:33.277876 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-6e3bd191-2f16-4820-a812-362d6d938f48 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:33.286464 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6e3bd191-2f16-4820-a812-362d6d938f48 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:33.287222 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6e3bd191-2f16-4820-a812-362d6d938f48 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:33.287822 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6e3bd191-2f16-4820-a812-362d6d938f48 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:33.288857 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6e3bd191-2f16-4820-a812-362d6d938f48 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:33.289315 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6e3bd191-2f16-4820-a812-362d6d938f48 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:33.289806 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6e3bd191-2f16-4820-a812-362d6d938f48 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:33.313229 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ee0f0d52-f341-440c-9948-341924b8676c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:33.322881 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ee0f0d52-f341-440c-9948-341924b8676c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.366605 Sep 13 01:20:33.324061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 148/280] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:32 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:33.431795 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6e3bd191-2f16-4820-a812-362d6d938f48 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:33.441835 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6e3bd191-2f16-4820-a812-362d6d938f48 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:33.443471 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6e3bd191-2f16-4820-a812-362d6d938f48 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:33.445564 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-6e3bd191-2f16-4820-a812-362d6d938f48 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.172994 Sep 13 01:20:33.446198 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 133/281] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:33 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:34.117524 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6c01c533-33d3-43bc-947b-a43a71494321 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:34.118185 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6c01c533-33d3-43bc-947b-a43a71494321 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:34.124775 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c01c533-33d3-43bc-947b-a43a71494321 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:34.125275 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c01c533-33d3-43bc-947b-a43a71494321 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:34.125712 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c01c533-33d3-43bc-947b-a43a71494321 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:34.126430 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c01c533-33d3-43bc-947b-a43a71494321 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:34.126882 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c01c533-33d3-43bc-947b-a43a71494321 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:34.127509 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c01c533-33d3-43bc-947b-a43a71494321 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:34.311411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-8ab589d4-a433-46b1-8e52-e8e7e8fd600d req-470069d8-b908-488a-8fdb-ce15b6eedd20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f2cc02-f632-47e6-8eae-b39a67ec2bab", "tag": "1ce4a6ed-1a1c-4f8d-acb8-36d90bdf6dbf"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:34.322233 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-8ab589d4-a433-46b1-8e52-e8e7e8fd600d req-470069d8-b908-488a-8fdb-ce15b6eedd20 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:34.323341 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-8ab589d4-a433-46b1-8e52-e8e7e8fd600d req-470069d8-b908-488a-8fdb-ce15b6eedd20 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:34.324044 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-8ab589d4-a433-46b1-8e52-e8e7e8fd600d req-470069d8-b908-488a-8fdb-ce15b6eedd20 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:34.327833 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6c01c533-33d3-43bc-947b-a43a71494321 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:34.340030 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6c01c533-33d3-43bc-947b-a43a71494321 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.226367 Sep 13 01:20:34.340622 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 149/282] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:34 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:34.353657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9a40b095-9b01-486f-8173-f46f4626e918 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:34.359233 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9a40b095-9b01-486f-8173-f46f4626e918 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:34.361544 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-8ab589d4-a433-46b1-8e52-e8e7e8fd600d req-470069d8-b908-488a-8fdb-ce15b6eedd20 service nova] Creating event network-changed:1ce4a6ed-1a1c-4f8d-acb8-36d90bdf6dbf for instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab on hv-cinder-85694 Sep 13 01:20:34.367742 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a40b095-9b01-486f-8173-f46f4626e918 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:34.368615 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a40b095-9b01-486f-8173-f46f4626e918 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:34.370124 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a40b095-9b01-486f-8173-f46f4626e918 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:34.371088 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a40b095-9b01-486f-8173-f46f4626e918 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:34.371218 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-8ab589d4-a433-46b1-8e52-e8e7e8fd600d req-470069d8-b908-488a-8fdb-ce15b6eedd20 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063920 Sep 13 01:20:34.372077 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 134/283] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:20:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:20:34.375021 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a40b095-9b01-486f-8173-f46f4626e918 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:34.375534 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a40b095-9b01-486f-8173-f46f4626e918 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:34.472288 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f07f9e8b-e6dc-4613-ba5f-4689ad396780 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:34.473168 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-f07f9e8b-e6dc-4613-ba5f-4689ad396780 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:34.481135 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f07f9e8b-e6dc-4613-ba5f-4689ad396780 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:34.482055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f07f9e8b-e6dc-4613-ba5f-4689ad396780 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:34.482787 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f07f9e8b-e6dc-4613-ba5f-4689ad396780 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:34.484071 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f07f9e8b-e6dc-4613-ba5f-4689ad396780 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:34.484743 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f07f9e8b-e6dc-4613-ba5f-4689ad396780 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:34.485362 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f07f9e8b-e6dc-4613-ba5f-4689ad396780 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:34.511316 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:34.537710 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9a40b095-9b01-486f-8173-f46f4626e918 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:34.547317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9a40b095-9b01-486f-8173-f46f4626e918 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1501 microversion: 2.1 time: 0.197366 Sep 13 01:20:34.547904 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 150/284] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:34 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1501 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:34.573432 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8ec441ed-1993-4d5e-9b26-c2ac82562f9b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3d075475-87de-4e60-92ac-39ae9f7e471b"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:34.576855 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8ec441ed-1993-4d5e-9b26-c2ac82562f9b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:34.586450 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ec441ed-1993-4d5e-9b26-c2ac82562f9b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:34.586450 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ec441ed-1993-4d5e-9b26-c2ac82562f9b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:34.586450 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ec441ed-1993-4d5e-9b26-c2ac82562f9b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:34.587067 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ec441ed-1993-4d5e-9b26-c2ac82562f9b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:34.587524 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ec441ed-1993-4d5e-9b26-c2ac82562f9b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:34.590030 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8ec441ed-1993-4d5e-9b26-c2ac82562f9b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:34.618078 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-8ec441ed-1993-4d5e-9b26-c2ac82562f9b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] HTTP exception thrown: Cannot 'attach_volume' instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b while it is in vm_state rescued Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8ec441ed-1993-4d5e-9b26-c2ac82562f9b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Request method failure captured: Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: POST /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b/os-volume_attachments HTTP/1.1 Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 74 Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9p4yMnrVK5GewsWLbTcRAz16uSc9TtrMuEljQX8sg0PXiBEAwAlB55augWK15AhNuOWCJg7_s89STcx-xwzZQh-CvS_k-5n7S0zKWbadfn4euhiUxAhZtEB4z7zlDtF2ivu7J04PPQiqOpRhilIzjzrHVHn7cC4gXETDbD4QP7c8NI Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: a84dd36fe9484f41bc2f0d7da4e47c13 Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:20:34.620616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:20:34.621943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a84dd36fe9484f41bc2f0d7da4e47c13"}]}] Sep 13 01:20:34.621943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:20:34.621943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: a84dd36fe9484f41bc2f0d7da4e47c13 Sep 13 01:20:34.621943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:20:34.621943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-ServerRescueNegativeTestJSON-293179200-project Sep 13 01:20:34.621943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:20:34.621943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:20:34.621943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 0c5dcfa5794843a5896fa051a4554e1f Sep 13 01:20:34.621943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-ServerRescueNegativeTestJSON-293179200-project Sep 13 01:20:34.621943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Sep 13 01:20:34.621943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {"volumeAttachment": {"volumeId": "3d075475-87de-4e60-92ac-39ae9f7e471b"}} Sep 13 01:20:34.621943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Cannot 'attach_volume' instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b while it is in vm_state rescued Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'server_id': '0091ed80-cb3c-4dce-b54c-48989fb19e7b', 'body': {'volumeAttachment': {'volumeId': '3d075475-87de-4e60-92ac-39ae9f7e471b'}}} Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:20:34.622697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b while it is in vm_state rescued Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:20:34.623889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:20:34.624996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:20:34.624996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:20:34.624996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b while it is in vm_state rescued Sep 13 01:20:34.624996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:20:34.624996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8ec441ed-1993-4d5e-9b26-c2ac82562f9b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Returning 409 to user: Cannot 'attach_volume' instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b while it is in vm_state rescued {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:20:34.624996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8ec441ed-1993-4d5e-9b26-c2ac82562f9b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "POST /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.056392 Sep 13 01:20:34.624996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 151/285] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:20:34 2022] POST /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b/os-volume_attachments => generated 152 bytes in 58 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 13 01:20:34.631909 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-605e793f-4ab0-448c-890c-3320da9f83c4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:34.632595 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-605e793f-4ab0-448c-890c-3320da9f83c4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:34.639125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-605e793f-4ab0-448c-890c-3320da9f83c4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:34.639608 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-605e793f-4ab0-448c-890c-3320da9f83c4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:34.643649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-605e793f-4ab0-448c-890c-3320da9f83c4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:34.643649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-605e793f-4ab0-448c-890c-3320da9f83c4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:34.643649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-605e793f-4ab0-448c-890c-3320da9f83c4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:34.643649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-605e793f-4ab0-448c-890c-3320da9f83c4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:34.725177 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-605e793f-4ab0-448c-890c-3320da9f83c4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "POST /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b/action" status: 202 len: 0 microversion: 2.1 time: 0.096430 Sep 13 01:20:34.727002 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 152/286] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:20:34 2022] POST /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b/action => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 01:20:34.733480 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f07f9e8b-e6dc-4613-ba5f-4689ad396780 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:34.747622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f07f9e8b-e6dc-4613-ba5f-4689ad396780 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:34.749813 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f07f9e8b-e6dc-4613-ba5f-4689ad396780 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:34.752580 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f07f9e8b-e6dc-4613-ba5f-4689ad396780 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.284240 Sep 13 01:20:34.754065 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 135/287] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:34 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:34.757203 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b31a23a7-8587-4959-be4b-589334d15e8d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:34.758337 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b31a23a7-8587-4959-be4b-589334d15e8d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:34.773652 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b31a23a7-8587-4959-be4b-589334d15e8d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:34.774021 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b31a23a7-8587-4959-be4b-589334d15e8d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:34.774484 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b31a23a7-8587-4959-be4b-589334d15e8d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:34.775232 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b31a23a7-8587-4959-be4b-589334d15e8d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:34.775685 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b31a23a7-8587-4959-be4b-589334d15e8d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:34.776647 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b31a23a7-8587-4959-be4b-589334d15e8d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:35.187816 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b31a23a7-8587-4959-be4b-589334d15e8d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:35.197392 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b31a23a7-8587-4959-be4b-589334d15e8d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1509 microversion: 2.1 time: 0.467403 Sep 13 01:20:35.198342 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 153/288] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:34 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1509 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:35.367573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-394390a3-9499-4cbd-89a4-2ae97ffed417 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:35.368571 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-394390a3-9499-4cbd-89a4-2ae97ffed417 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:35.375706 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-394390a3-9499-4cbd-89a4-2ae97ffed417 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:35.376184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-394390a3-9499-4cbd-89a4-2ae97ffed417 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:35.376623 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-394390a3-9499-4cbd-89a4-2ae97ffed417 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:35.377391 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-394390a3-9499-4cbd-89a4-2ae97ffed417 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:35.377887 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-394390a3-9499-4cbd-89a4-2ae97ffed417 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:35.378306 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-394390a3-9499-4cbd-89a4-2ae97ffed417 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:35.565390 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-394390a3-9499-4cbd-89a4-2ae97ffed417 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:35.573846 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-394390a3-9499-4cbd-89a4-2ae97ffed417 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.209646 Sep 13 01:20:35.574753 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 136/289] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:35 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:35.782908 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3ebbecd8-e82a-43db-8db1-dbeb6f521dcc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:35.783528 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3ebbecd8-e82a-43db-8db1-dbeb6f521dcc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:35.790375 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ebbecd8-e82a-43db-8db1-dbeb6f521dcc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:35.790917 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ebbecd8-e82a-43db-8db1-dbeb6f521dcc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:35.791356 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ebbecd8-e82a-43db-8db1-dbeb6f521dcc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:35.792110 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ebbecd8-e82a-43db-8db1-dbeb6f521dcc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:35.792588 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ebbecd8-e82a-43db-8db1-dbeb6f521dcc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:35.793007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3ebbecd8-e82a-43db-8db1-dbeb6f521dcc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:35.921298 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3ebbecd8-e82a-43db-8db1-dbeb6f521dcc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:35.929185 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3ebbecd8-e82a-43db-8db1-dbeb6f521dcc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:35.930612 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3ebbecd8-e82a-43db-8db1-dbeb6f521dcc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:35.931784 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3ebbecd8-e82a-43db-8db1-dbeb6f521dcc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.152985 Sep 13 01:20:35.932392 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 154/290] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:35 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:36.220606 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d7eb9acc-ddac-4cc0-a597-2b55f4cdcf20 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:36.221212 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d7eb9acc-ddac-4cc0-a597-2b55f4cdcf20 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:36.227080 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d7eb9acc-ddac-4cc0-a597-2b55f4cdcf20 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:36.227560 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d7eb9acc-ddac-4cc0-a597-2b55f4cdcf20 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:36.227991 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d7eb9acc-ddac-4cc0-a597-2b55f4cdcf20 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:36.228669 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d7eb9acc-ddac-4cc0-a597-2b55f4cdcf20 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:36.229121 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d7eb9acc-ddac-4cc0-a597-2b55f4cdcf20 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:36.229539 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d7eb9acc-ddac-4cc0-a597-2b55f4cdcf20 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:36.359678 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d7eb9acc-ddac-4cc0-a597-2b55f4cdcf20 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:36.367293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d7eb9acc-ddac-4cc0-a597-2b55f4cdcf20 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1509 microversion: 2.1 time: 0.150471 Sep 13 01:20:36.367863 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 137/291] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:36 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:36.600999 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fb3d3911-f6bf-4d30-9636-27871e1ca18f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:36.601597 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fb3d3911-f6bf-4d30-9636-27871e1ca18f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:36.608276 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb3d3911-f6bf-4d30-9636-27871e1ca18f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:36.608768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb3d3911-f6bf-4d30-9636-27871e1ca18f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:36.609204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb3d3911-f6bf-4d30-9636-27871e1ca18f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:36.609893 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb3d3911-f6bf-4d30-9636-27871e1ca18f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:36.610347 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb3d3911-f6bf-4d30-9636-27871e1ca18f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:36.610769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fb3d3911-f6bf-4d30-9636-27871e1ca18f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:36.743553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fb3d3911-f6bf-4d30-9636-27871e1ca18f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:36.752168 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fb3d3911-f6bf-4d30-9636-27871e1ca18f tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.155073 Sep 13 01:20:36.752722 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 155/292] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:36 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:36.957569 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-885b7a2b-896b-4d79-98df-720c5dfb86df tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:36.958204 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-885b7a2b-896b-4d79-98df-720c5dfb86df tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:36.965784 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-885b7a2b-896b-4d79-98df-720c5dfb86df tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:36.966517 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-885b7a2b-896b-4d79-98df-720c5dfb86df tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:36.966976 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-885b7a2b-896b-4d79-98df-720c5dfb86df tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:36.967664 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-885b7a2b-896b-4d79-98df-720c5dfb86df tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:36.968139 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-885b7a2b-896b-4d79-98df-720c5dfb86df tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:36.968552 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-885b7a2b-896b-4d79-98df-720c5dfb86df tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:37.101765 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-885b7a2b-896b-4d79-98df-720c5dfb86df tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:37.111038 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-885b7a2b-896b-4d79-98df-720c5dfb86df tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:37.112511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-885b7a2b-896b-4d79-98df-720c5dfb86df tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:37.113686 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-885b7a2b-896b-4d79-98df-720c5dfb86df tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.160029 Sep 13 01:20:37.114248 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 138/293] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:36 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:37.390675 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f5004584-8f0f-479c-8601-b109ad699d8b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:37.391385 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f5004584-8f0f-479c-8601-b109ad699d8b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:37.398138 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5004584-8f0f-479c-8601-b109ad699d8b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:37.398613 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5004584-8f0f-479c-8601-b109ad699d8b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:37.399088 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5004584-8f0f-479c-8601-b109ad699d8b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:37.399801 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5004584-8f0f-479c-8601-b109ad699d8b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:37.400252 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5004584-8f0f-479c-8601-b109ad699d8b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:37.400674 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5004584-8f0f-479c-8601-b109ad699d8b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:37.529144 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f5004584-8f0f-479c-8601-b109ad699d8b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:37.532745 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:37.539849 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f5004584-8f0f-479c-8601-b109ad699d8b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1509 microversion: 2.1 time: 0.152897 Sep 13 01:20:37.540432 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 156/294] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:37 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:37.775060 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-af4377ae-babf-42f7-987f-f99eecbe45b8 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:37.775677 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-af4377ae-babf-42f7-987f-f99eecbe45b8 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:37.782278 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-af4377ae-babf-42f7-987f-f99eecbe45b8 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:37.782764 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-af4377ae-babf-42f7-987f-f99eecbe45b8 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:37.783232 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-af4377ae-babf-42f7-987f-f99eecbe45b8 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:37.783921 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-af4377ae-babf-42f7-987f-f99eecbe45b8 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:37.784376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-af4377ae-babf-42f7-987f-f99eecbe45b8 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:37.784798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-af4377ae-babf-42f7-987f-f99eecbe45b8 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:37.802765 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=22 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:37.915859 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-af4377ae-babf-42f7-987f-f99eecbe45b8 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:37.924033 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-af4377ae-babf-42f7-987f-f99eecbe45b8 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.152935 Sep 13 01:20:37.924594 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 139/295] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:37 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:38.144076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-67954f89-0099-462c-8793-9ff28f947aef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:38.144688 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-67954f89-0099-462c-8793-9ff28f947aef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:38.152473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-67954f89-0099-462c-8793-9ff28f947aef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:38.152962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-67954f89-0099-462c-8793-9ff28f947aef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:38.153398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-67954f89-0099-462c-8793-9ff28f947aef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:38.154098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-67954f89-0099-462c-8793-9ff28f947aef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:38.154551 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-67954f89-0099-462c-8793-9ff28f947aef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:38.155014 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-67954f89-0099-462c-8793-9ff28f947aef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:38.291412 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-67954f89-0099-462c-8793-9ff28f947aef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:38.299487 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-67954f89-0099-462c-8793-9ff28f947aef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:38.300935 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-67954f89-0099-462c-8793-9ff28f947aef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:38.302055 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-67954f89-0099-462c-8793-9ff28f947aef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.166709 Sep 13 01:20:38.302603 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 157/296] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:38 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:38.563988 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-fcf23c9c-f241-4d58-9d25-c9b0cb2d867a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:38.564513 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-fcf23c9c-f241-4d58-9d25-c9b0cb2d867a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:38.571454 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fcf23c9c-f241-4d58-9d25-c9b0cb2d867a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:38.571940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fcf23c9c-f241-4d58-9d25-c9b0cb2d867a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:38.572523 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fcf23c9c-f241-4d58-9d25-c9b0cb2d867a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:38.573092 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fcf23c9c-f241-4d58-9d25-c9b0cb2d867a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:38.573544 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fcf23c9c-f241-4d58-9d25-c9b0cb2d867a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:38.574213 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fcf23c9c-f241-4d58-9d25-c9b0cb2d867a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:38.704237 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-fcf23c9c-f241-4d58-9d25-c9b0cb2d867a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:38.711787 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-fcf23c9c-f241-4d58-9d25-c9b0cb2d867a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1515 microversion: 2.1 time: 0.152096 Sep 13 01:20:38.712349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 140/297] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:38 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:38.950067 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-98638c6a-e8b8-46df-a5dc-20858e761513 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:38.950677 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-98638c6a-e8b8-46df-a5dc-20858e761513 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:38.957139 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-98638c6a-e8b8-46df-a5dc-20858e761513 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:38.957632 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-98638c6a-e8b8-46df-a5dc-20858e761513 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:38.958053 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-98638c6a-e8b8-46df-a5dc-20858e761513 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:38.958757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-98638c6a-e8b8-46df-a5dc-20858e761513 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:38.959225 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-98638c6a-e8b8-46df-a5dc-20858e761513 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:38.959641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-98638c6a-e8b8-46df-a5dc-20858e761513 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:39.118551 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-98638c6a-e8b8-46df-a5dc-20858e761513 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:39.126181 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-98638c6a-e8b8-46df-a5dc-20858e761513 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.180374 Sep 13 01:20:39.126829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 158/298] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:38 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:39.328290 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-077dcc1a-e5d1-4798-a234-a02f906df98b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:39.328886 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-077dcc1a-e5d1-4798-a234-a02f906df98b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:39.334658 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-077dcc1a-e5d1-4798-a234-a02f906df98b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:39.335184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-077dcc1a-e5d1-4798-a234-a02f906df98b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:39.335759 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-077dcc1a-e5d1-4798-a234-a02f906df98b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:39.336469 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-077dcc1a-e5d1-4798-a234-a02f906df98b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:39.336921 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-077dcc1a-e5d1-4798-a234-a02f906df98b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:39.337492 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-077dcc1a-e5d1-4798-a234-a02f906df98b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:39.468970 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-077dcc1a-e5d1-4798-a234-a02f906df98b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:39.477349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-077dcc1a-e5d1-4798-a234-a02f906df98b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:39.478799 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-077dcc1a-e5d1-4798-a234-a02f906df98b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:39.480002 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-077dcc1a-e5d1-4798-a234-a02f906df98b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.157208 Sep 13 01:20:39.480584 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 141/299] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:39 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:40.110248 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c881cd7a-c3df-4e79-b475-11fde4cf3891 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Action: 'create', calling method: .version_select at 0x7fb05e6885e0>, body: {"keypair": {"name": "tempest-keypair-2131583893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFiJteYT+lTdPzrlTeVSimROZogh9CrrW113UydgT7adHZzVU706KPT5M6t9a8A8igpUSL7wUGT3eSACX8ns4e/Gofx50vOaK9ozQNCtBgvyAoYpj4kuPGhQV/vbfc54Tw=="}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:40.126048 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-c881cd7a-c3df-4e79-b475-11fde4cf3891 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Getting quotas for project a84dd36fe9484f41bc2f0d7da4e47c13. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:20:40.134595 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-c881cd7a-c3df-4e79-b475-11fde4cf3891 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Getting quotas for user 0c5dcfa5794843a5896fa051a4554e1f and project a84dd36fe9484f41bc2f0d7da4e47c13. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:20:40.149805 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-00da0d22-2885-4262-b5ff-02f568c9ace1 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:40.150506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-00da0d22-2885-4262-b5ff-02f568c9ace1 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:40.157576 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-00da0d22-2885-4262-b5ff-02f568c9ace1 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:40.158141 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-00da0d22-2885-4262-b5ff-02f568c9ace1 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:40.158681 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-00da0d22-2885-4262-b5ff-02f568c9ace1 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:40.159443 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-00da0d22-2885-4262-b5ff-02f568c9ace1 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:40.160187 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-00da0d22-2885-4262-b5ff-02f568c9ace1 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:40.160829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-00da0d22-2885-4262-b5ff-02f568c9ace1 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:40.161656 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c881cd7a-c3df-4e79-b475-11fde4cf3891 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.054916 Sep 13 01:20:40.162504 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 159/300] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 01:20:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:20:40.323441 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-00da0d22-2885-4262-b5ff-02f568c9ace1 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:40.332521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-00da0d22-2885-4262-b5ff-02f568c9ace1 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.186514 Sep 13 01:20:40.334286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 142/301] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:40 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:40.505750 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-378698f3-bb48-46e7-bfce-0b9fa25fafb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:40.506374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-378698f3-bb48-46e7-bfce-0b9fa25fafb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:40.512470 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-378698f3-bb48-46e7-bfce-0b9fa25fafb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:40.512962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-378698f3-bb48-46e7-bfce-0b9fa25fafb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:40.513398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-378698f3-bb48-46e7-bfce-0b9fa25fafb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:40.514102 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-378698f3-bb48-46e7-bfce-0b9fa25fafb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:40.514725 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-378698f3-bb48-46e7-bfce-0b9fa25fafb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:40.515351 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-378698f3-bb48-46e7-bfce-0b9fa25fafb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:40.663831 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9ad45905-25ee-4d88-a6e9-fba613e4f67c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:40.670321 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ad45905-25ee-4d88-a6e9-fba613e4f67c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:40.670806 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ad45905-25ee-4d88-a6e9-fba613e4f67c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:40.671330 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ad45905-25ee-4d88-a6e9-fba613e4f67c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:40.708801 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-378698f3-bb48-46e7-bfce-0b9fa25fafb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:40.724745 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-378698f3-bb48-46e7-bfce-0b9fa25fafb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:40.727536 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-378698f3-bb48-46e7-bfce-0b9fa25fafb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:40.731116 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-378698f3-bb48-46e7-bfce-0b9fa25fafb4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.229606 Sep 13 01:20:40.736876 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 160/302] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:40 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:40.762249 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9ad45905-25ee-4d88-a6e9-fba613e4f67c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Going to try to stop instance {{(pid=120412) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 01:20:40.810470 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9ad45905-25ee-4d88-a6e9-fba613e4f67c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "POST /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/action" status: 202 len: 0 microversion: 2.1 time: 0.149949 Sep 13 01:20:40.811397 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 143/303] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:20:40 2022] POST /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/action => generated 0 bytes in 152 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 01:20:40.820745 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0f1e9895-d189-4175-8d22-efaa4be663bd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:40.821356 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0f1e9895-d189-4175-8d22-efaa4be663bd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:40.828486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0f1e9895-d189-4175-8d22-efaa4be663bd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:40.829289 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0f1e9895-d189-4175-8d22-efaa4be663bd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:40.829723 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0f1e9895-d189-4175-8d22-efaa4be663bd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:40.830434 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0f1e9895-d189-4175-8d22-efaa4be663bd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:40.831015 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0f1e9895-d189-4175-8d22-efaa4be663bd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:40.831387 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0f1e9895-d189-4175-8d22-efaa4be663bd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:40.975788 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0f1e9895-d189-4175-8d22-efaa4be663bd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:40.985309 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0f1e9895-d189-4175-8d22-efaa4be663bd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.169738 Sep 13 01:20:40.986017 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 161/304] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:40 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:41.357458 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-6119993d-89aa-4501-a0e2-531f171c402c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:41.358214 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-6119993d-89aa-4501-a0e2-531f171c402c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:41.364196 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6119993d-89aa-4501-a0e2-531f171c402c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:41.364674 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6119993d-89aa-4501-a0e2-531f171c402c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:41.365107 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6119993d-89aa-4501-a0e2-531f171c402c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:41.365829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6119993d-89aa-4501-a0e2-531f171c402c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:41.366278 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6119993d-89aa-4501-a0e2-531f171c402c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:41.366696 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6119993d-89aa-4501-a0e2-531f171c402c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:41.556714 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6119993d-89aa-4501-a0e2-531f171c402c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:41.566271 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-6119993d-89aa-4501-a0e2-531f171c402c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.213630 Sep 13 01:20:41.578881 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 144/305] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:41 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:41.618462 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-954373215", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f76e7426-2310-4c50-8ad0-bf7be7b0fe24"}], "security_groups": [{"name": "tempest-securitygroup--1621675547"}], "key_name": "tempest-keypair-2131583893", "user_data": "}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:41.759435 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a9c6a53b-6a40-4f01-acfa-154a041a7810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:41.760129 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a9c6a53b-6a40-4f01-acfa-154a041a7810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:41.767043 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a9c6a53b-6a40-4f01-acfa-154a041a7810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:41.767613 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a9c6a53b-6a40-4f01-acfa-154a041a7810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:41.768054 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a9c6a53b-6a40-4f01-acfa-154a041a7810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:41.768930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a9c6a53b-6a40-4f01-acfa-154a041a7810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:41.769343 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a9c6a53b-6a40-4f01-acfa-154a041a7810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:41.769950 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a9c6a53b-6a40-4f01-acfa-154a041a7810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:41.911823 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a9c6a53b-6a40-4f01-acfa-154a041a7810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:41.920207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a9c6a53b-6a40-4f01-acfa-154a041a7810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:41.921894 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a9c6a53b-6a40-4f01-acfa-154a041a7810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:41.923152 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a9c6a53b-6a40-4f01-acfa-154a041a7810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.167633 Sep 13 01:20:41.923917 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 145/306] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:41 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:20:42.008971 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-bb68b196-32b1-4675-8fdd-32a0860b644a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:42.009583 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-bb68b196-32b1-4675-8fdd-32a0860b644a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:42.016086 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bb68b196-32b1-4675-8fdd-32a0860b644a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:42.016573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bb68b196-32b1-4675-8fdd-32a0860b644a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:42.017012 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bb68b196-32b1-4675-8fdd-32a0860b644a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:42.017703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bb68b196-32b1-4675-8fdd-32a0860b644a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:42.018161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bb68b196-32b1-4675-8fdd-32a0860b644a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:42.018587 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bb68b196-32b1-4675-8fdd-32a0860b644a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:42.147154 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-bb68b196-32b1-4675-8fdd-32a0860b644a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:42.156712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-bb68b196-32b1-4675-8fdd-32a0860b644a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.151497 Sep 13 01:20:42.157313 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 146/307] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:42 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:42.590189 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c2d17dbc-3da4-4d4e-a365-8f8704c0c902 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:42.590790 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c2d17dbc-3da4-4d4e-a365-8f8704c0c902 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:42.597067 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2d17dbc-3da4-4d4e-a365-8f8704c0c902 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:42.597647 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2d17dbc-3da4-4d4e-a365-8f8704c0c902 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:42.598140 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2d17dbc-3da4-4d4e-a365-8f8704c0c902 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:42.598835 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2d17dbc-3da4-4d4e-a365-8f8704c0c902 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:42.599305 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2d17dbc-3da4-4d4e-a365-8f8704c0c902 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:42.599722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2d17dbc-3da4-4d4e-a365-8f8704c0c902 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:42.752951 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c2d17dbc-3da4-4d4e-a365-8f8704c0c902 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:42.760698 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c2d17dbc-3da4-4d4e-a365-8f8704c0c902 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.175118 Sep 13 01:20:42.761272 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 147/308] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:42 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:42.948847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-29c605b0-0033-4d5a-9de2-6a4f3689f2c9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:42.949394 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-29c605b0-0033-4d5a-9de2-6a4f3689f2c9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:42.955331 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-29c605b0-0033-4d5a-9de2-6a4f3689f2c9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:42.955811 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-29c605b0-0033-4d5a-9de2-6a4f3689f2c9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:42.956241 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-29c605b0-0033-4d5a-9de2-6a4f3689f2c9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:42.956920 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-29c605b0-0033-4d5a-9de2-6a4f3689f2c9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:42.957367 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-29c605b0-0033-4d5a-9de2-6a4f3689f2c9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:42.957788 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-29c605b0-0033-4d5a-9de2-6a4f3689f2c9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:43.085603 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-29c605b0-0033-4d5a-9de2-6a4f3689f2c9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:43.094212 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-29c605b0-0033-4d5a-9de2-6a4f3689f2c9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:43.095658 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-29c605b0-0033-4d5a-9de2-6a4f3689f2c9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:43.096810 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-29c605b0-0033-4d5a-9de2-6a4f3689f2c9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.152006 Sep 13 01:20:43.097360 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 148/309] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:42 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:20:43.180177 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7e8e06da-7819-4a2b-8cd1-a8e7df82fa85 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:43.180919 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7e8e06da-7819-4a2b-8cd1-a8e7df82fa85 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:43.187398 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e8e06da-7819-4a2b-8cd1-a8e7df82fa85 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:43.187911 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e8e06da-7819-4a2b-8cd1-a8e7df82fa85 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:43.188373 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e8e06da-7819-4a2b-8cd1-a8e7df82fa85 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:43.189119 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e8e06da-7819-4a2b-8cd1-a8e7df82fa85 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:43.189604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e8e06da-7819-4a2b-8cd1-a8e7df82fa85 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:43.190036 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e8e06da-7819-4a2b-8cd1-a8e7df82fa85 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:43.339376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7e8e06da-7819-4a2b-8cd1-a8e7df82fa85 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:43.347721 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7e8e06da-7819-4a2b-8cd1-a8e7df82fa85 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.171553 Sep 13 01:20:43.348295 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 149/310] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:43 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:43.784225 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b3594ea9-9ebb-400f-8cd1-cb5cc819630c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:43.784883 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b3594ea9-9ebb-400f-8cd1-cb5cc819630c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:43.791597 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b3594ea9-9ebb-400f-8cd1-cb5cc819630c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:43.792093 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b3594ea9-9ebb-400f-8cd1-cb5cc819630c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:43.792534 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b3594ea9-9ebb-400f-8cd1-cb5cc819630c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:43.793254 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b3594ea9-9ebb-400f-8cd1-cb5cc819630c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:43.793714 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b3594ea9-9ebb-400f-8cd1-cb5cc819630c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:43.794147 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b3594ea9-9ebb-400f-8cd1-cb5cc819630c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:43.931745 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b3594ea9-9ebb-400f-8cd1-cb5cc819630c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:43.939661 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b3594ea9-9ebb-400f-8cd1-cb5cc819630c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.159456 Sep 13 01:20:43.940230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 150/311] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:43 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:44.122152 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0a2b06a9-7c3f-4d9b-ae5d-5ff8f37c1224 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:44.125351 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0a2b06a9-7c3f-4d9b-ae5d-5ff8f37c1224 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:44.131450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0a2b06a9-7c3f-4d9b-ae5d-5ff8f37c1224 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:44.132035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0a2b06a9-7c3f-4d9b-ae5d-5ff8f37c1224 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:44.132570 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0a2b06a9-7c3f-4d9b-ae5d-5ff8f37c1224 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:44.133353 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0a2b06a9-7c3f-4d9b-ae5d-5ff8f37c1224 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:44.133883 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0a2b06a9-7c3f-4d9b-ae5d-5ff8f37c1224 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:44.134409 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0a2b06a9-7c3f-4d9b-ae5d-5ff8f37c1224 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:44.140047 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:44.336601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0a2b06a9-7c3f-4d9b-ae5d-5ff8f37c1224 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:44.346958 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0a2b06a9-7c3f-4d9b-ae5d-5ff8f37c1224 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:44.348423 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0a2b06a9-7c3f-4d9b-ae5d-5ff8f37c1224 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:44.349619 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0a2b06a9-7c3f-4d9b-ae5d-5ff8f37c1224 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.231607 Sep 13 01:20:44.351185 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 151/312] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:44 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:44.371799 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8bd7e567-5740-4bc3-b746-47108d2c3358 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:44.372680 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-8bd7e567-5740-4bc3-b746-47108d2c3358 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:44.378401 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8bd7e567-5740-4bc3-b746-47108d2c3358 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:44.378913 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8bd7e567-5740-4bc3-b746-47108d2c3358 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:44.379356 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8bd7e567-5740-4bc3-b746-47108d2c3358 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:44.380052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8bd7e567-5740-4bc3-b746-47108d2c3358 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:44.380503 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8bd7e567-5740-4bc3-b746-47108d2c3358 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:44.380926 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8bd7e567-5740-4bc3-b746-47108d2c3358 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:44.568066 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-8bd7e567-5740-4bc3-b746-47108d2c3358 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:44.577158 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-8bd7e567-5740-4bc3-b746-47108d2c3358 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.209151 Sep 13 01:20:44.593319 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 152/313] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:44 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:44.656881 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-5c905d00-3e87-48d6-a31e-5adf4f476362 req-5d211588-e021-405d-a945-8f36aa05edb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf5279a7-4859-458b-958c-85fd71cb4d72", "name": "network-vif-plugged", "status": "completed", "tag": "c4858902-df62-4017-b106-503915275745"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:44.670235 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-5c905d00-3e87-48d6-a31e-5adf4f476362 req-5d211588-e021-405d-a945-8f36aa05edb4 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:44.670952 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-5c905d00-3e87-48d6-a31e-5adf4f476362 req-5d211588-e021-405d-a945-8f36aa05edb4 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:44.671624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-5c905d00-3e87-48d6-a31e-5adf4f476362 req-5d211588-e021-405d-a945-8f36aa05edb4 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:44.685677 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-5c905d00-3e87-48d6-a31e-5adf4f476362 req-5d211588-e021-405d-a945-8f36aa05edb4 service nova] Creating event network-vif-plugged:c4858902-df62-4017-b106-503915275745 for instance cf5279a7-4859-458b-958c-85fd71cb4d72 on hv-cinder-85694 Sep 13 01:20:44.690976 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-5c905d00-3e87-48d6-a31e-5adf4f476362 req-5d211588-e021-405d-a945-8f36aa05edb4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038700 Sep 13 01:20:44.692001 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 153/314] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:20:44.971397 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b0043321-e6b9-485a-8a5f-09eb9f307f38 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:44.971397 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b0043321-e6b9-485a-8a5f-09eb9f307f38 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:44.971397 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0043321-e6b9-485a-8a5f-09eb9f307f38 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:44.972120 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0043321-e6b9-485a-8a5f-09eb9f307f38 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:44.972704 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0043321-e6b9-485a-8a5f-09eb9f307f38 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:44.973597 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0043321-e6b9-485a-8a5f-09eb9f307f38 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:44.974056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0043321-e6b9-485a-8a5f-09eb9f307f38 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:44.974473 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0043321-e6b9-485a-8a5f-09eb9f307f38 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:45.198536 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b0043321-e6b9-485a-8a5f-09eb9f307f38 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:45.206504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b0043321-e6b9-485a-8a5f-09eb9f307f38 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.248621 Sep 13 01:20:45.207109 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 154/315] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:44 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:45.376026 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4a497765-3c01-47e0-988c-8ba8d7f2b8cf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:45.376663 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4a497765-3c01-47e0-988c-8ba8d7f2b8cf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:45.382710 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4a497765-3c01-47e0-988c-8ba8d7f2b8cf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:45.383313 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4a497765-3c01-47e0-988c-8ba8d7f2b8cf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:45.383804 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4a497765-3c01-47e0-988c-8ba8d7f2b8cf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:45.384561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4a497765-3c01-47e0-988c-8ba8d7f2b8cf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:45.385686 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4a497765-3c01-47e0-988c-8ba8d7f2b8cf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:45.386117 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4a497765-3c01-47e0-988c-8ba8d7f2b8cf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:45.528110 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4a497765-3c01-47e0-988c-8ba8d7f2b8cf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:45.536167 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4a497765-3c01-47e0-988c-8ba8d7f2b8cf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:45.537614 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4a497765-3c01-47e0-988c-8ba8d7f2b8cf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:45.538770 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4a497765-3c01-47e0-988c-8ba8d7f2b8cf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.167066 Sep 13 01:20:45.539356 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 155/316] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:45 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:20:45.601024 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-530e270a-1e7f-449d-bcb2-418d92fa9844 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:45.601631 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-530e270a-1e7f-449d-bcb2-418d92fa9844 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:45.608073 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-530e270a-1e7f-449d-bcb2-418d92fa9844 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:45.608560 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-530e270a-1e7f-449d-bcb2-418d92fa9844 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:45.608994 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-530e270a-1e7f-449d-bcb2-418d92fa9844 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:45.609686 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-530e270a-1e7f-449d-bcb2-418d92fa9844 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:45.610141 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-530e270a-1e7f-449d-bcb2-418d92fa9844 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:45.610566 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-530e270a-1e7f-449d-bcb2-418d92fa9844 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:45.750924 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-530e270a-1e7f-449d-bcb2-418d92fa9844 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:45.759067 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-530e270a-1e7f-449d-bcb2-418d92fa9844 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.161897 Sep 13 01:20:45.759628 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 156/317] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:45 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:46.230189 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-cacda702-fc9b-467a-95c8-880abec37c70 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:46.231691 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-cacda702-fc9b-467a-95c8-880abec37c70 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:46.238410 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cacda702-fc9b-467a-95c8-880abec37c70 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:46.239052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cacda702-fc9b-467a-95c8-880abec37c70 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:46.239491 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cacda702-fc9b-467a-95c8-880abec37c70 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:46.240197 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cacda702-fc9b-467a-95c8-880abec37c70 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:46.240677 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cacda702-fc9b-467a-95c8-880abec37c70 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:46.241102 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cacda702-fc9b-467a-95c8-880abec37c70 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:46.367815 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-cacda702-fc9b-467a-95c8-880abec37c70 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:46.375629 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-cacda702-fc9b-467a-95c8-880abec37c70 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1259 microversion: 2.1 time: 0.149791 Sep 13 01:20:46.376289 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 157/318] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:46 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:46.564237 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e9e469df-6a50-4f12-a13b-8b958f93795c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:46.564767 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-e9e469df-6a50-4f12-a13b-8b958f93795c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:46.570495 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e9e469df-6a50-4f12-a13b-8b958f93795c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:46.571020 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e9e469df-6a50-4f12-a13b-8b958f93795c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:46.571457 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e9e469df-6a50-4f12-a13b-8b958f93795c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:46.572147 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e9e469df-6a50-4f12-a13b-8b958f93795c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:46.573103 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e9e469df-6a50-4f12-a13b-8b958f93795c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:46.573531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e9e469df-6a50-4f12-a13b-8b958f93795c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:46.707443 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-e9e469df-6a50-4f12-a13b-8b958f93795c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:46.716132 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-e9e469df-6a50-4f12-a13b-8b958f93795c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:46.717578 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-e9e469df-6a50-4f12-a13b-8b958f93795c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:46.718798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-e9e469df-6a50-4f12-a13b-8b958f93795c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.158792 Sep 13 01:20:46.719494 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 158/319] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:46 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:20:46.781654 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7930de1e-e403-4169-a229-519e488a0b1f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:46.782269 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7930de1e-e403-4169-a229-519e488a0b1f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:46.788144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7930de1e-e403-4169-a229-519e488a0b1f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:46.788633 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7930de1e-e403-4169-a229-519e488a0b1f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:46.789094 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7930de1e-e403-4169-a229-519e488a0b1f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:46.789785 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7930de1e-e403-4169-a229-519e488a0b1f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:46.790244 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7930de1e-e403-4169-a229-519e488a0b1f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:46.790670 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7930de1e-e403-4169-a229-519e488a0b1f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:46.921950 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7930de1e-e403-4169-a229-519e488a0b1f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:46.930261 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7930de1e-e403-4169-a229-519e488a0b1f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.152453 Sep 13 01:20:46.930829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 159/320] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:46 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:47.317613 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] validate_networks() for [('f76e7426-2310-4c50-8ad0-bf7be7b0fe24', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:20:47.399656 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-21dca47f-3732-40d8-9ad0-a2e6e681980d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:47.400269 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-21dca47f-3732-40d8-9ad0-a2e6e681980d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:47.418495 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21dca47f-3732-40d8-9ad0-a2e6e681980d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:47.419026 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21dca47f-3732-40d8-9ad0-a2e6e681980d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:47.419464 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21dca47f-3732-40d8-9ad0-a2e6e681980d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:47.420175 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21dca47f-3732-40d8-9ad0-a2e6e681980d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:47.420627 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21dca47f-3732-40d8-9ad0-a2e6e681980d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:47.421048 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21dca47f-3732-40d8-9ad0-a2e6e681980d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:47.572596 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-21dca47f-3732-40d8-9ad0-a2e6e681980d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:47.580736 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-21dca47f-3732-40d8-9ad0-a2e6e681980d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1442 microversion: 2.1 time: 0.186014 Sep 13 01:20:47.581314 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 160/321] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:47 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1442 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:47.603501 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7f4b2ff5-90d0-4f9e-b2be-26c7cf81b206 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:47.604710 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7f4b2ff5-90d0-4f9e-b2be-26c7cf81b206 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:47.610409 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7f4b2ff5-90d0-4f9e-b2be-26c7cf81b206 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:47.610921 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7f4b2ff5-90d0-4f9e-b2be-26c7cf81b206 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:47.611409 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7f4b2ff5-90d0-4f9e-b2be-26c7cf81b206 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:47.612106 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7f4b2ff5-90d0-4f9e-b2be-26c7cf81b206 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:47.612553 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7f4b2ff5-90d0-4f9e-b2be-26c7cf81b206 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:47.612971 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7f4b2ff5-90d0-4f9e-b2be-26c7cf81b206 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:47.718250 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:20:47.718806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:20:47.719384 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:20:47.719867 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:20:47.720494 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:20:47.731090 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:47.731671 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:47.732195 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:47.733003 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:47.733535 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:47.734034 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:47.753794 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Getting quotas for project a84dd36fe9484f41bc2f0d7da4e47c13. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:20:47.759487 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Getting quotas for user 0c5dcfa5794843a5896fa051a4554e1f and project a84dd36fe9484f41bc2f0d7da4e47c13. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:20:47.761510 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7f4b2ff5-90d0-4f9e-b2be-26c7cf81b206 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:47.769440 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7f4b2ff5-90d0-4f9e-b2be-26c7cf81b206 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1442 microversion: 2.1 time: 0.169629 Sep 13 01:20:47.770024 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 161/322] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:47 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1442 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:47.779130 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:20:47.779242 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a2eacabf-5953-410a-aaf8-f16a0c27abf6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:47.779242 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a2eacabf-5953-410a-aaf8-f16a0c27abf6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:47.779445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:20:47.784351 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a2eacabf-5953-410a-aaf8-f16a0c27abf6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:47.784914 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a2eacabf-5953-410a-aaf8-f16a0c27abf6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:47.785456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a2eacabf-5953-410a-aaf8-f16a0c27abf6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:47.786254 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a2eacabf-5953-410a-aaf8-f16a0c27abf6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:47.786811 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a2eacabf-5953-410a-aaf8-f16a0c27abf6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:47.787367 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a2eacabf-5953-410a-aaf8-f16a0c27abf6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:47.829553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-41905ea2-2b45-4cd4-9e91-2aa7c21b9e57 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 6.215329 Sep 13 01:20:47.830685 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 162/323] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:20:41 2022] POST /compute/v2.1/servers => generated 409 bytes in 6217 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 01:20:47.843535 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7bc3985a-9939-4c1f-8dab-509edcf63ff4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:47.844271 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7bc3985a-9939-4c1f-8dab-509edcf63ff4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:47.907930 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7bc3985a-9939-4c1f-8dab-509edcf63ff4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:47.935687 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7bc3985a-9939-4c1f-8dab-509edcf63ff4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1245 microversion: 2.1 time: 0.097526 Sep 13 01:20:47.936799 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 163/324] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:47 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1245 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:47.954551 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-54dc4b64-dae8-4c8a-95d4-fce528ee5949 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:47.955211 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-54dc4b64-dae8-4c8a-95d4-fce528ee5949 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:47.962597 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54dc4b64-dae8-4c8a-95d4-fce528ee5949 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:47.963526 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54dc4b64-dae8-4c8a-95d4-fce528ee5949 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:47.964048 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54dc4b64-dae8-4c8a-95d4-fce528ee5949 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:47.964660 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54dc4b64-dae8-4c8a-95d4-fce528ee5949 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:47.965149 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54dc4b64-dae8-4c8a-95d4-fce528ee5949 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:47.965688 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-54dc4b64-dae8-4c8a-95d4-fce528ee5949 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:47.970951 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a2eacabf-5953-410a-aaf8-f16a0c27abf6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:47.981542 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a2eacabf-5953-410a-aaf8-f16a0c27abf6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:47.982490 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a2eacabf-5953-410a-aaf8-f16a0c27abf6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:47.984977 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a2eacabf-5953-410a-aaf8-f16a0c27abf6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.213484 Sep 13 01:20:47.984977 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 162/325] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:47 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:48.137043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-54dc4b64-dae8-4c8a-95d4-fce528ee5949 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:48.146590 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-54dc4b64-dae8-4c8a-95d4-fce528ee5949 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.196359 Sep 13 01:20:48.159693 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 164/326] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:47 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:48.959988 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3b317a29-c607-44bd-866b-18bd3e15d786 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:48.960651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3b317a29-c607-44bd-866b-18bd3e15d786 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:48.967102 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3b317a29-c607-44bd-866b-18bd3e15d786 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:48.967585 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3b317a29-c607-44bd-866b-18bd3e15d786 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:48.968023 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3b317a29-c607-44bd-866b-18bd3e15d786 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:48.968713 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3b317a29-c607-44bd-866b-18bd3e15d786 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:48.969169 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3b317a29-c607-44bd-866b-18bd3e15d786 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:48.969596 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3b317a29-c607-44bd-866b-18bd3e15d786 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:49.009796 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fee16f6b-6950-43d1-bb57-3ef366c548c1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:49.011059 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fee16f6b-6950-43d1-bb57-3ef366c548c1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:49.017425 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fee16f6b-6950-43d1-bb57-3ef366c548c1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:49.017908 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fee16f6b-6950-43d1-bb57-3ef366c548c1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:49.018339 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fee16f6b-6950-43d1-bb57-3ef366c548c1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:49.019053 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fee16f6b-6950-43d1-bb57-3ef366c548c1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:49.019509 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fee16f6b-6950-43d1-bb57-3ef366c548c1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:49.020065 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fee16f6b-6950-43d1-bb57-3ef366c548c1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:49.045798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3b317a29-c607-44bd-866b-18bd3e15d786 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:49.053683 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3b317a29-c607-44bd-866b-18bd3e15d786 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1297 microversion: 2.1 time: 0.097517 Sep 13 01:20:49.054269 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 163/327] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:48 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1297 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:49.156586 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fee16f6b-6950-43d1-bb57-3ef366c548c1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:49.165004 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fee16f6b-6950-43d1-bb57-3ef366c548c1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:49.166888 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fee16f6b-6950-43d1-bb57-3ef366c548c1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:49.168495 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fee16f6b-6950-43d1-bb57-3ef366c548c1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.162789 Sep 13 01:20:49.169125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 165/328] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:49 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:20:49.171873 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-bc113205-2bbd-4410-85a7-0066f5e7c745 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:49.172490 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-bc113205-2bbd-4410-85a7-0066f5e7c745 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:49.183311 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bc113205-2bbd-4410-85a7-0066f5e7c745 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:49.184111 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bc113205-2bbd-4410-85a7-0066f5e7c745 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:49.184706 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bc113205-2bbd-4410-85a7-0066f5e7c745 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:49.185911 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bc113205-2bbd-4410-85a7-0066f5e7c745 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:49.186644 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bc113205-2bbd-4410-85a7-0066f5e7c745 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:49.187273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bc113205-2bbd-4410-85a7-0066f5e7c745 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:49.398763 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-bc113205-2bbd-4410-85a7-0066f5e7c745 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:49.410795 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-bc113205-2bbd-4410-85a7-0066f5e7c745 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.242826 Sep 13 01:20:49.411558 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 164/329] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:49 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:49.905426 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-6f5a09bc-6163-45ad-800e-22b56aa944c4 req-7f96b9ca-89c9-4b89-b361-553865c25df4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf5279a7-4859-458b-958c-85fd71cb4d72", "tag": "c4858902-df62-4017-b106-503915275745"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:49.915080 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6f5a09bc-6163-45ad-800e-22b56aa944c4 req-7f96b9ca-89c9-4b89-b361-553865c25df4 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:49.915677 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6f5a09bc-6163-45ad-800e-22b56aa944c4 req-7f96b9ca-89c9-4b89-b361-553865c25df4 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:49.916347 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6f5a09bc-6163-45ad-800e-22b56aa944c4 req-7f96b9ca-89c9-4b89-b361-553865c25df4 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:49.927705 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-6f5a09bc-6163-45ad-800e-22b56aa944c4 req-7f96b9ca-89c9-4b89-b361-553865c25df4 service nova] Creating event network-changed:c4858902-df62-4017-b106-503915275745 for instance cf5279a7-4859-458b-958c-85fd71cb4d72 on hv-cinder-85694 Sep 13 01:20:49.933232 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-6f5a09bc-6163-45ad-800e-22b56aa944c4 req-7f96b9ca-89c9-4b89-b361-553865c25df4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031473 Sep 13 01:20:49.934038 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 166/330] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:20:50.077412 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1b3b0e64-649e-4750-9239-13eb00fb48e7 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:50.078670 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1b3b0e64-649e-4750-9239-13eb00fb48e7 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:50.085268 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1b3b0e64-649e-4750-9239-13eb00fb48e7 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:50.085750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1b3b0e64-649e-4750-9239-13eb00fb48e7 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:50.086375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1b3b0e64-649e-4750-9239-13eb00fb48e7 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:50.087111 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1b3b0e64-649e-4750-9239-13eb00fb48e7 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:50.087628 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1b3b0e64-649e-4750-9239-13eb00fb48e7 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:50.088691 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1b3b0e64-649e-4750-9239-13eb00fb48e7 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:50.180319 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1b3b0e64-649e-4750-9239-13eb00fb48e7 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:50.190037 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1b3b0e64-649e-4750-9239-13eb00fb48e7 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1303 microversion: 2.1 time: 0.116582 Sep 13 01:20:50.191355 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 165/331] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:50 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:50.212335 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-de5b1e7b-d8e9-4c55-a9c5-ce30405e9d5e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:50.214294 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-de5b1e7b-d8e9-4c55-a9c5-ce30405e9d5e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:50.228697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de5b1e7b-d8e9-4c55-a9c5-ce30405e9d5e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:50.232084 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de5b1e7b-d8e9-4c55-a9c5-ce30405e9d5e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:50.232830 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de5b1e7b-d8e9-4c55-a9c5-ce30405e9d5e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:50.233584 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de5b1e7b-d8e9-4c55-a9c5-ce30405e9d5e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:50.234050 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de5b1e7b-d8e9-4c55-a9c5-ce30405e9d5e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:50.234467 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de5b1e7b-d8e9-4c55-a9c5-ce30405e9d5e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:50.407721 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-de5b1e7b-d8e9-4c55-a9c5-ce30405e9d5e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:50.420259 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-de5b1e7b-d8e9-4c55-a9c5-ce30405e9d5e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:50.421953 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-de5b1e7b-d8e9-4c55-a9c5-ce30405e9d5e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:50.423403 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-de5b1e7b-d8e9-4c55-a9c5-ce30405e9d5e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.215927 Sep 13 01:20:50.424141 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 167/332] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:50 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:50.441295 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-646b0feb-bc02-45db-82f3-be1f6049f664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:50.441295 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-646b0feb-bc02-45db-82f3-be1f6049f664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:50.447917 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-646b0feb-bc02-45db-82f3-be1f6049f664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:50.449157 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-646b0feb-bc02-45db-82f3-be1f6049f664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:50.449864 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-646b0feb-bc02-45db-82f3-be1f6049f664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:50.450719 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-646b0feb-bc02-45db-82f3-be1f6049f664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:50.451404 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-646b0feb-bc02-45db-82f3-be1f6049f664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:50.451835 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-646b0feb-bc02-45db-82f3-be1f6049f664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:50.858255 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-646b0feb-bc02-45db-82f3-be1f6049f664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:50.867580 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-646b0feb-bc02-45db-82f3-be1f6049f664 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.432052 Sep 13 01:20:50.875676 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 166/333] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:50 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:51.214340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9603f648-b53d-4d43-b58b-a33ede361dda tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:51.215253 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9603f648-b53d-4d43-b58b-a33ede361dda tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:51.225659 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9603f648-b53d-4d43-b58b-a33ede361dda tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:51.226333 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9603f648-b53d-4d43-b58b-a33ede361dda tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:51.227725 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9603f648-b53d-4d43-b58b-a33ede361dda tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:51.229838 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9603f648-b53d-4d43-b58b-a33ede361dda tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:51.230657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9603f648-b53d-4d43-b58b-a33ede361dda tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:51.231235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9603f648-b53d-4d43-b58b-a33ede361dda tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:51.374111 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9603f648-b53d-4d43-b58b-a33ede361dda tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:51.382398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9603f648-b53d-4d43-b58b-a33ede361dda tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1371 microversion: 2.1 time: 0.172436 Sep 13 01:20:51.383082 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 168/334] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:51 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:51.448752 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8382bc67-16e6-4043-ad72-465c0f675c65 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:51.449493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-8382bc67-16e6-4043-ad72-465c0f675c65 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:51.455943 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8382bc67-16e6-4043-ad72-465c0f675c65 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:51.456429 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8382bc67-16e6-4043-ad72-465c0f675c65 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:51.456865 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8382bc67-16e6-4043-ad72-465c0f675c65 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:51.457773 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8382bc67-16e6-4043-ad72-465c0f675c65 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:51.458228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8382bc67-16e6-4043-ad72-465c0f675c65 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:51.458653 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8382bc67-16e6-4043-ad72-465c0f675c65 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:51.686211 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-8382bc67-16e6-4043-ad72-465c0f675c65 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:51.694350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-8382bc67-16e6-4043-ad72-465c0f675c65 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:51.695809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-8382bc67-16e6-4043-ad72-465c0f675c65 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:51.696959 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-8382bc67-16e6-4043-ad72-465c0f675c65 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1743 microversion: 2.20 time: 0.252312 Sep 13 01:20:51.698109 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 167/335] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:51 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1743 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:51.891734 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-01fe8cdf-92cf-49dd-9c3a-2dd0d66e169d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:51.892342 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-01fe8cdf-92cf-49dd-9c3a-2dd0d66e169d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:51.898323 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01fe8cdf-92cf-49dd-9c3a-2dd0d66e169d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:51.898813 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01fe8cdf-92cf-49dd-9c3a-2dd0d66e169d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:51.899277 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01fe8cdf-92cf-49dd-9c3a-2dd0d66e169d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:51.899971 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01fe8cdf-92cf-49dd-9c3a-2dd0d66e169d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:51.901035 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01fe8cdf-92cf-49dd-9c3a-2dd0d66e169d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:51.901460 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01fe8cdf-92cf-49dd-9c3a-2dd0d66e169d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:51.958303 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-9ed0bd0c-6848-4fa6-b859-9212a639fbf3 req-e051d9b7-eac5-4a7f-a8c6-cfa38f591e64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89f56d9-6326-419a-ad10-fb520d83ec2a", "tag": "d4354f6f-2db0-4d03-a3d4-4ddab59e9460"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:51.968849 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-9ed0bd0c-6848-4fa6-b859-9212a639fbf3 req-e051d9b7-eac5-4a7f-a8c6-cfa38f591e64 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:51.969535 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-9ed0bd0c-6848-4fa6-b859-9212a639fbf3 req-e051d9b7-eac5-4a7f-a8c6-cfa38f591e64 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:51.970153 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-9ed0bd0c-6848-4fa6-b859-9212a639fbf3 req-e051d9b7-eac5-4a7f-a8c6-cfa38f591e64 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:51.982074 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-9ed0bd0c-6848-4fa6-b859-9212a639fbf3 req-e051d9b7-eac5-4a7f-a8c6-cfa38f591e64 service nova] Creating event network-changed:d4354f6f-2db0-4d03-a3d4-4ddab59e9460 for instance d89f56d9-6326-419a-ad10-fb520d83ec2a on hv-cinder-85694 Sep 13 01:20:51.987035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-9ed0bd0c-6848-4fa6-b859-9212a639fbf3 req-e051d9b7-eac5-4a7f-a8c6-cfa38f591e64 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032466 Sep 13 01:20:51.987720 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 168/336] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:20:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:20:52.031054 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-01fe8cdf-92cf-49dd-9c3a-2dd0d66e169d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:52.039363 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-01fe8cdf-92cf-49dd-9c3a-2dd0d66e169d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.151427 Sep 13 01:20:52.039923 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 169/337] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:51 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:52.405631 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8d7062e4-74ab-4a17-8142-9f44772e88e8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:52.406332 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-8d7062e4-74ab-4a17-8142-9f44772e88e8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:52.412518 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d7062e4-74ab-4a17-8142-9f44772e88e8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:52.413007 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d7062e4-74ab-4a17-8142-9f44772e88e8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:52.413442 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d7062e4-74ab-4a17-8142-9f44772e88e8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:52.414327 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d7062e4-74ab-4a17-8142-9f44772e88e8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:52.415141 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d7062e4-74ab-4a17-8142-9f44772e88e8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:52.415260 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d7062e4-74ab-4a17-8142-9f44772e88e8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:52.419407 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=100 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:52.540519 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-8d7062e4-74ab-4a17-8142-9f44772e88e8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:52.548763 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-8d7062e4-74ab-4a17-8142-9f44772e88e8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1371 microversion: 2.1 time: 0.147319 Sep 13 01:20:52.549345 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 169/338] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:52 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1371 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:52.723493 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ed7ad28e-90e0-40b4-a30c-ffa8c08b9c4f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:52.724151 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ed7ad28e-90e0-40b4-a30c-ffa8c08b9c4f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:52.730699 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed7ad28e-90e0-40b4-a30c-ffa8c08b9c4f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:52.731214 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed7ad28e-90e0-40b4-a30c-ffa8c08b9c4f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:52.731655 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed7ad28e-90e0-40b4-a30c-ffa8c08b9c4f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:52.732352 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed7ad28e-90e0-40b4-a30c-ffa8c08b9c4f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:52.732810 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed7ad28e-90e0-40b4-a30c-ffa8c08b9c4f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:52.733237 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ed7ad28e-90e0-40b4-a30c-ffa8c08b9c4f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:52.864646 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ed7ad28e-90e0-40b4-a30c-ffa8c08b9c4f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:52.873208 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ed7ad28e-90e0-40b4-a30c-ffa8c08b9c4f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:52.874660 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ed7ad28e-90e0-40b4-a30c-ffa8c08b9c4f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:52.875854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ed7ad28e-90e0-40b4-a30c-ffa8c08b9c4f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1743 microversion: 2.20 time: 0.156388 Sep 13 01:20:52.876414 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 170/339] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:52 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1743 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:53.063700 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-914e1125-bd9a-43e3-87db-d0aa0ecdb9ec tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:53.064211 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-914e1125-bd9a-43e3-87db-d0aa0ecdb9ec tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:53.070032 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-914e1125-bd9a-43e3-87db-d0aa0ecdb9ec tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:53.070508 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-914e1125-bd9a-43e3-87db-d0aa0ecdb9ec tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:53.070971 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-914e1125-bd9a-43e3-87db-d0aa0ecdb9ec tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:53.071655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-914e1125-bd9a-43e3-87db-d0aa0ecdb9ec tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:53.072718 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-914e1125-bd9a-43e3-87db-d0aa0ecdb9ec tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:53.073143 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-914e1125-bd9a-43e3-87db-d0aa0ecdb9ec tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:53.197029 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-914e1125-bd9a-43e3-87db-d0aa0ecdb9ec tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:53.205378 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-914e1125-bd9a-43e3-87db-d0aa0ecdb9ec tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.145898 Sep 13 01:20:53.205948 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 170/340] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:53 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:53.571712 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9e043156-7098-4f86-abb6-2ff54a5464c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:53.572268 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9e043156-7098-4f86-abb6-2ff54a5464c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:53.578358 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e043156-7098-4f86-abb6-2ff54a5464c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:53.578879 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e043156-7098-4f86-abb6-2ff54a5464c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:53.579321 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e043156-7098-4f86-abb6-2ff54a5464c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:53.580264 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e043156-7098-4f86-abb6-2ff54a5464c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:53.580755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e043156-7098-4f86-abb6-2ff54a5464c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:53.581237 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e043156-7098-4f86-abb6-2ff54a5464c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:53.706016 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9e043156-7098-4f86-abb6-2ff54a5464c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:53.714512 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9e043156-7098-4f86-abb6-2ff54a5464c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1371 microversion: 2.1 time: 0.146646 Sep 13 01:20:53.715116 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 171/341] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:53 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:53.902411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-97ba24e0-0ab9-49e0-a228-47b1def2aa81 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:53.902943 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-97ba24e0-0ab9-49e0-a228-47b1def2aa81 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:53.908763 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-97ba24e0-0ab9-49e0-a228-47b1def2aa81 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:53.909246 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-97ba24e0-0ab9-49e0-a228-47b1def2aa81 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:53.909676 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-97ba24e0-0ab9-49e0-a228-47b1def2aa81 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:53.910376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-97ba24e0-0ab9-49e0-a228-47b1def2aa81 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:53.910819 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-97ba24e0-0ab9-49e0-a228-47b1def2aa81 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:53.911287 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-97ba24e0-0ab9-49e0-a228-47b1def2aa81 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:53.986294 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-799188631", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1305807284", "security_groups": [{"name": "tempest-secgroup-smoke-161750292"}], "block_device_mapping_v2": [{"uuid": "72d1500a-0d12-4501-80d2-3b3910e31b8e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0a90ed41-eeae-4dbf-a9a3-4da26905e9e8"}]}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:54.101374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] validate_networks() for [('0a90ed41-eeae-4dbf-a9a3-4da26905e9e8', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:20:54.121014 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-97ba24e0-0ab9-49e0-a228-47b1def2aa81 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:54.129274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-97ba24e0-0ab9-49e0-a228-47b1def2aa81 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:54.131684 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-97ba24e0-0ab9-49e0-a228-47b1def2aa81 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:54.132967 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-97ba24e0-0ab9-49e0-a228-47b1def2aa81 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1743 microversion: 2.20 time: 0.235703 Sep 13 01:20:54.142307 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 171/342] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:53 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1743 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:54.228719 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-177a5d57-77d9-431f-a09b-076975639315 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:54.229412 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-177a5d57-77d9-431f-a09b-076975639315 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:54.235376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-177a5d57-77d9-431f-a09b-076975639315 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:54.235871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-177a5d57-77d9-431f-a09b-076975639315 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:54.236310 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-177a5d57-77d9-431f-a09b-076975639315 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:54.237019 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-177a5d57-77d9-431f-a09b-076975639315 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:54.237482 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-177a5d57-77d9-431f-a09b-076975639315 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:54.237914 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-177a5d57-77d9-431f-a09b-076975639315 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:54.365964 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-177a5d57-77d9-431f-a09b-076975639315 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:54.374423 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-177a5d57-77d9-431f-a09b-076975639315 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.149591 Sep 13 01:20:54.375029 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 172/343] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:54 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:54.477986 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:20:54.479181 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:20:54.479607 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:20:54.480054 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:20:54.480473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:20:54.489412 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:54.489901 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:54.490362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:54.491105 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:54.491564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:54.491992 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:54.508684 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Getting quotas for project 66cdd4ec03ea4fbf959ede65bb96f6ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:20:54.512652 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Getting quotas for user 2842b222fe6b4821a670d13ec8febf1a and project 66cdd4ec03ea4fbf959ede65bb96f6ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:20:54.569944 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:20:54.572204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72d1500a-0d12-4501-80d2-3b3910e31b8e',volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:20:54.702623 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2d4ae7ab-88ab-4680-b599-dc61af457bae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.720116 Sep 13 01:20:54.703508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 172/344] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:20:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 722 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 01:20:54.714513 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-460d7437-54f2-478a-b467-dfa9c3c87b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:54.715095 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-460d7437-54f2-478a-b467-dfa9c3c87b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:54.749894 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-56a79b42-234a-49f5-a878-4838a874de76 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:54.750802 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-56a79b42-234a-49f5-a878-4838a874de76 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:54.758775 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56a79b42-234a-49f5-a878-4838a874de76 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:54.759406 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56a79b42-234a-49f5-a878-4838a874de76 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:54.760210 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56a79b42-234a-49f5-a878-4838a874de76 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:54.761027 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56a79b42-234a-49f5-a878-4838a874de76 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:54.761941 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56a79b42-234a-49f5-a878-4838a874de76 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:54.761941 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56a79b42-234a-49f5-a878-4838a874de76 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:54.771017 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-460d7437-54f2-478a-b467-dfa9c3c87b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:54.778406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-460d7437-54f2-478a-b467-dfa9c3c87b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1094 microversion: 2.1 time: 0.067872 Sep 13 01:20:54.781491 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 173/345] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:54 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1094 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:54.923471 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-56a79b42-234a-49f5-a878-4838a874de76 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:54.931629 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-56a79b42-234a-49f5-a878-4838a874de76 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1371 microversion: 2.1 time: 0.197643 Sep 13 01:20:54.934898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 173/346] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:54 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:55.158930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-bce86018-65af-4e06-b91f-4517405e1f15 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:55.160235 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-bce86018-65af-4e06-b91f-4517405e1f15 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:55.166626 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bce86018-65af-4e06-b91f-4517405e1f15 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:55.167130 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bce86018-65af-4e06-b91f-4517405e1f15 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:55.167575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bce86018-65af-4e06-b91f-4517405e1f15 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:55.168384 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bce86018-65af-4e06-b91f-4517405e1f15 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:55.168854 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bce86018-65af-4e06-b91f-4517405e1f15 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:55.169449 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bce86018-65af-4e06-b91f-4517405e1f15 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:55.307109 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-bce86018-65af-4e06-b91f-4517405e1f15 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:55.316002 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-bce86018-65af-4e06-b91f-4517405e1f15 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:55.317469 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-bce86018-65af-4e06-b91f-4517405e1f15 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:55.318634 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-bce86018-65af-4e06-b91f-4517405e1f15 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1743 microversion: 2.20 time: 0.163887 Sep 13 01:20:55.319268 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 174/347] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:55 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1743 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:55.397482 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-710829d5-3f4a-4124-9691-cc1301628d58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:55.398144 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-710829d5-3f4a-4124-9691-cc1301628d58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:55.400513 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:55.409327 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-710829d5-3f4a-4124-9691-cc1301628d58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:55.409984 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-710829d5-3f4a-4124-9691-cc1301628d58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:55.410701 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-710829d5-3f4a-4124-9691-cc1301628d58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:55.411588 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-710829d5-3f4a-4124-9691-cc1301628d58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:55.412195 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-710829d5-3f4a-4124-9691-cc1301628d58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:55.412739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-710829d5-3f4a-4124-9691-cc1301628d58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:55.546721 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-710829d5-3f4a-4124-9691-cc1301628d58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:55.555633 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-710829d5-3f4a-4124-9691-cc1301628d58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.161992 Sep 13 01:20:55.556199 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 174/348] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:55 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:55.803381 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-dcf04b31-d7e9-4528-ad73-3664c801ec35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:55.803922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-dcf04b31-d7e9-4528-ad73-3664c801ec35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:55.810658 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dcf04b31-d7e9-4528-ad73-3664c801ec35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:55.811243 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dcf04b31-d7e9-4528-ad73-3664c801ec35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:55.811680 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dcf04b31-d7e9-4528-ad73-3664c801ec35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:55.812372 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dcf04b31-d7e9-4528-ad73-3664c801ec35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:55.812827 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dcf04b31-d7e9-4528-ad73-3664c801ec35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:55.813254 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dcf04b31-d7e9-4528-ad73-3664c801ec35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:55.883176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-dcf04b31-d7e9-4528-ad73-3664c801ec35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:55.891594 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-dcf04b31-d7e9-4528-ad73-3664c801ec35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1192 microversion: 2.1 time: 0.092151 Sep 13 01:20:55.892157 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 175/349] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:55 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1192 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:55.957053 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-16b5eb32-d8f6-46bd-a30b-24ac476a3e5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:55.957693 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-16b5eb32-d8f6-46bd-a30b-24ac476a3e5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:55.963546 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-16b5eb32-d8f6-46bd-a30b-24ac476a3e5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:55.964031 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-16b5eb32-d8f6-46bd-a30b-24ac476a3e5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:55.964462 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-16b5eb32-d8f6-46bd-a30b-24ac476a3e5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:55.965151 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-16b5eb32-d8f6-46bd-a30b-24ac476a3e5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:55.965597 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-16b5eb32-d8f6-46bd-a30b-24ac476a3e5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:55.966018 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-16b5eb32-d8f6-46bd-a30b-24ac476a3e5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:56.101962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-16b5eb32-d8f6-46bd-a30b-24ac476a3e5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:56.113333 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-16b5eb32-d8f6-46bd-a30b-24ac476a3e5b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1371 microversion: 2.1 time: 0.159976 Sep 13 01:20:56.113942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 175/350] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:55 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:56.344878 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-482f2ca6-3669-422c-ad1f-544149fc540e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:56.345493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-482f2ca6-3669-422c-ad1f-544149fc540e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:56.353239 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-482f2ca6-3669-422c-ad1f-544149fc540e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:56.353239 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-482f2ca6-3669-422c-ad1f-544149fc540e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:56.353722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-482f2ca6-3669-422c-ad1f-544149fc540e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:56.354429 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-482f2ca6-3669-422c-ad1f-544149fc540e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:56.355007 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-482f2ca6-3669-422c-ad1f-544149fc540e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:56.355446 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-482f2ca6-3669-422c-ad1f-544149fc540e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:56.567259 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-482f2ca6-3669-422c-ad1f-544149fc540e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:56.577342 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-482f2ca6-3669-422c-ad1f-544149fc540e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:56.578797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-482f2ca6-3669-422c-ad1f-544149fc540e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:56.579615 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3a2962a0-a468-4f3f-bb12-58fe73455c99 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:56.580424 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-482f2ca6-3669-422c-ad1f-544149fc540e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1743 microversion: 2.20 time: 0.239087 Sep 13 01:20:56.581293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 176/351] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:56 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1743 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:56.581500 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3a2962a0-a468-4f3f-bb12-58fe73455c99 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:56.599983 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a2962a0-a468-4f3f-bb12-58fe73455c99 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:56.600608 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a2962a0-a468-4f3f-bb12-58fe73455c99 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:56.601149 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a2962a0-a468-4f3f-bb12-58fe73455c99 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:56.601946 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a2962a0-a468-4f3f-bb12-58fe73455c99 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:56.602460 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a2962a0-a468-4f3f-bb12-58fe73455c99 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:56.603656 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a2962a0-a468-4f3f-bb12-58fe73455c99 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:56.793479 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3a2962a0-a468-4f3f-bb12-58fe73455c99 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:56.808979 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3a2962a0-a468-4f3f-bb12-58fe73455c99 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.233331 Sep 13 01:20:56.810332 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 176/352] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:56 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:56.913886 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-204a1d0d-7333-4e6b-807f-095be1ffe35f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:56.914517 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-204a1d0d-7333-4e6b-807f-095be1ffe35f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:56.920859 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-204a1d0d-7333-4e6b-807f-095be1ffe35f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:56.921484 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-204a1d0d-7333-4e6b-807f-095be1ffe35f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:56.922251 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-204a1d0d-7333-4e6b-807f-095be1ffe35f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:56.923366 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-204a1d0d-7333-4e6b-807f-095be1ffe35f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:56.924023 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-204a1d0d-7333-4e6b-807f-095be1ffe35f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:56.924623 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-204a1d0d-7333-4e6b-807f-095be1ffe35f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:57.008583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-d5ceba00-c68c-4ffc-8f08-ad0f1b014ca1 req-693db58f-a343-4a39-855c-45520b043b9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1677b90a-17f0-496f-8fce-ac573509c1ac", "name": "network-vif-plugged", "status": "completed", "tag": "88cd16db-1d4f-46f0-9069-3f6713e3efbd"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:57.022534 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-d5ceba00-c68c-4ffc-8f08-ad0f1b014ca1 req-693db58f-a343-4a39-855c-45520b043b9d service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:57.023286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-d5ceba00-c68c-4ffc-8f08-ad0f1b014ca1 req-693db58f-a343-4a39-855c-45520b043b9d service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:57.024040 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-d5ceba00-c68c-4ffc-8f08-ad0f1b014ca1 req-693db58f-a343-4a39-855c-45520b043b9d service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:57.037182 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-d5ceba00-c68c-4ffc-8f08-ad0f1b014ca1 req-693db58f-a343-4a39-855c-45520b043b9d service nova] Creating event network-vif-plugged:88cd16db-1d4f-46f0-9069-3f6713e3efbd for instance 1677b90a-17f0-496f-8fce-ac573509c1ac on hv-cinder-85694 Sep 13 01:20:57.043825 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-d5ceba00-c68c-4ffc-8f08-ad0f1b014ca1 req-693db58f-a343-4a39-855c-45520b043b9d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040988 Sep 13 01:20:57.044699 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 177/353] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:20:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:20:57.138731 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c4305c47-c449-4652-b007-960bd8393d71 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:57.139469 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c4305c47-c449-4652-b007-960bd8393d71 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:57.145687 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4305c47-c449-4652-b007-960bd8393d71 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:57.146178 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4305c47-c449-4652-b007-960bd8393d71 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:57.146614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4305c47-c449-4652-b007-960bd8393d71 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:57.147353 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4305c47-c449-4652-b007-960bd8393d71 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:57.147807 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4305c47-c449-4652-b007-960bd8393d71 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:57.148232 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4305c47-c449-4652-b007-960bd8393d71 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:57.152993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:57.168900 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-204a1d0d-7333-4e6b-807f-095be1ffe35f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:57.177271 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-204a1d0d-7333-4e6b-807f-095be1ffe35f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.267445 Sep 13 01:20:57.178152 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 177/354] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:56 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:57.287892 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c4305c47-c449-4652-b007-960bd8393d71 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:57.296156 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c4305c47-c449-4652-b007-960bd8393d71 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1371 microversion: 2.1 time: 0.162213 Sep 13 01:20:57.296727 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 178/355] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:57 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:57.605621 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-bfdf4998-43ec-4d27-8611-35f506164d95 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:57.606260 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-bfdf4998-43ec-4d27-8611-35f506164d95 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:57.612635 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfdf4998-43ec-4d27-8611-35f506164d95 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:57.613179 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfdf4998-43ec-4d27-8611-35f506164d95 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:57.613554 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfdf4998-43ec-4d27-8611-35f506164d95 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:57.614254 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfdf4998-43ec-4d27-8611-35f506164d95 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:57.614704 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfdf4998-43ec-4d27-8611-35f506164d95 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:57.615151 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfdf4998-43ec-4d27-8611-35f506164d95 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:57.836900 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-181e221d-7150-4fd0-9b82-b84e93215c6f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:57.838490 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-181e221d-7150-4fd0-9b82-b84e93215c6f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:57.851541 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-181e221d-7150-4fd0-9b82-b84e93215c6f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:57.854920 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-181e221d-7150-4fd0-9b82-b84e93215c6f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:57.857031 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-181e221d-7150-4fd0-9b82-b84e93215c6f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:57.858450 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-181e221d-7150-4fd0-9b82-b84e93215c6f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:57.859277 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-181e221d-7150-4fd0-9b82-b84e93215c6f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:57.860719 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-181e221d-7150-4fd0-9b82-b84e93215c6f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:58.064450 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-181e221d-7150-4fd0-9b82-b84e93215c6f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:58.069910 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-bfdf4998-43ec-4d27-8611-35f506164d95 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:58.074885 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-181e221d-7150-4fd0-9b82-b84e93215c6f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.242580 Sep 13 01:20:58.083899 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 179/356] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:57 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:58.100993 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-bfdf4998-43ec-4d27-8611-35f506164d95 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:58.103037 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-bfdf4998-43ec-4d27-8611-35f506164d95 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:58.106569 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-c83a244f-7588-465d-8677-c550bae2121e req-6281df09-43db-4f86-90d7-a43f957fdfc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8555c188-5c8f-4a84-877b-c97fe0265c5c", "tag": "6c6841ec-d12a-4293-a896-c6083998f37f"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:58.112866 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-bfdf4998-43ec-4d27-8611-35f506164d95 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1738 microversion: 2.20 time: 0.510649 Sep 13 01:20:58.115910 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 178/357] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:57 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1738 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:58.128257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-c83a244f-7588-465d-8677-c550bae2121e req-6281df09-43db-4f86-90d7-a43f957fdfc7 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:58.128928 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-c83a244f-7588-465d-8677-c550bae2121e req-6281df09-43db-4f86-90d7-a43f957fdfc7 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:58.130891 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-c83a244f-7588-465d-8677-c550bae2121e req-6281df09-43db-4f86-90d7-a43f957fdfc7 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:58.155546 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-c83a244f-7588-465d-8677-c550bae2121e req-6281df09-43db-4f86-90d7-a43f957fdfc7 service nova] Creating event network-changed:6c6841ec-d12a-4293-a896-c6083998f37f for instance 8555c188-5c8f-4a84-877b-c97fe0265c5c on hv-cinder-85694 Sep 13 01:20:58.161180 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-c83a244f-7588-465d-8677-c550bae2121e req-6281df09-43db-4f86-90d7-a43f957fdfc7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075075 Sep 13 01:20:58.162566 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 180/358] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:20:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:20:58.200930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-259ae35d-a732-40a3-a453-f224a8878cdb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:58.201601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-259ae35d-a732-40a3-a453-f224a8878cdb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:58.203649 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=100 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:20:58.209542 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-259ae35d-a732-40a3-a453-f224a8878cdb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:58.210113 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-259ae35d-a732-40a3-a453-f224a8878cdb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:58.210691 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-259ae35d-a732-40a3-a453-f224a8878cdb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:58.211663 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-259ae35d-a732-40a3-a453-f224a8878cdb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:58.213111 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-259ae35d-a732-40a3-a453-f224a8878cdb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:58.213813 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-259ae35d-a732-40a3-a453-f224a8878cdb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:58.322980 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4abdd754-064f-490b-a72c-c172dc1381d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:58.324086 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4abdd754-064f-490b-a72c-c172dc1381d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:58.333155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4abdd754-064f-490b-a72c-c172dc1381d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:58.333985 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4abdd754-064f-490b-a72c-c172dc1381d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:58.334698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4abdd754-064f-490b-a72c-c172dc1381d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:58.335576 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4abdd754-064f-490b-a72c-c172dc1381d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:58.345659 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4abdd754-064f-490b-a72c-c172dc1381d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:58.346135 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4abdd754-064f-490b-a72c-c172dc1381d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:58.506722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-259ae35d-a732-40a3-a453-f224a8878cdb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:58.519509 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-259ae35d-a732-40a3-a453-f224a8878cdb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.322433 Sep 13 01:20:58.520799 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 179/359] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:58 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:58.578652 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4abdd754-064f-490b-a72c-c172dc1381d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:58.587053 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4abdd754-064f-490b-a72c-c172dc1381d4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1371 microversion: 2.1 time: 0.269692 Sep 13 01:20:58.588600 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 181/360] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:58 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1371 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:59.061044 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-bf9e67ed-ccaf-48b1-8184-3ad19d45ecfc req-4d5f0dea-cb2c-469c-a8c2-58585427b3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89f56d9-6326-419a-ad10-fb520d83ec2a", "name": "network-vif-plugged", "status": "completed", "tag": "d4354f6f-2db0-4d03-a3d4-4ddab59e9460"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:20:59.070886 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-bf9e67ed-ccaf-48b1-8184-3ad19d45ecfc req-4d5f0dea-cb2c-469c-a8c2-58585427b3b1 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:59.071370 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-bf9e67ed-ccaf-48b1-8184-3ad19d45ecfc req-4d5f0dea-cb2c-469c-a8c2-58585427b3b1 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:59.072430 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-bf9e67ed-ccaf-48b1-8184-3ad19d45ecfc req-4d5f0dea-cb2c-469c-a8c2-58585427b3b1 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:59.084027 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-bf9e67ed-ccaf-48b1-8184-3ad19d45ecfc req-4d5f0dea-cb2c-469c-a8c2-58585427b3b1 service nova] Creating event network-vif-plugged:d4354f6f-2db0-4d03-a3d4-4ddab59e9460 for instance d89f56d9-6326-419a-ad10-fb520d83ec2a on hv-cinder-85694 Sep 13 01:20:59.088990 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-bf9e67ed-ccaf-48b1-8184-3ad19d45ecfc req-4d5f0dea-cb2c-469c-a8c2-58585427b3b1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034580 Sep 13 01:20:59.090091 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 180/361] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:20:59.100192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-759f32de-d8a8-45cb-89bd-0c0dcb5199ed tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:59.100897 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-759f32de-d8a8-45cb-89bd-0c0dcb5199ed tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:59.109234 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-759f32de-d8a8-45cb-89bd-0c0dcb5199ed tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:59.109863 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-759f32de-d8a8-45cb-89bd-0c0dcb5199ed tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:59.110389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-759f32de-d8a8-45cb-89bd-0c0dcb5199ed tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:59.111271 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-759f32de-d8a8-45cb-89bd-0c0dcb5199ed tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:59.111781 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-759f32de-d8a8-45cb-89bd-0c0dcb5199ed tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:59.112514 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-759f32de-d8a8-45cb-89bd-0c0dcb5199ed tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:59.145782 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-21ad7e40-4952-4da5-93da-8930e6333c3a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:59.146625 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-21ad7e40-4952-4da5-93da-8930e6333c3a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:59.160108 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21ad7e40-4952-4da5-93da-8930e6333c3a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:59.160644 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21ad7e40-4952-4da5-93da-8930e6333c3a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:59.161124 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21ad7e40-4952-4da5-93da-8930e6333c3a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:59.162051 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21ad7e40-4952-4da5-93da-8930e6333c3a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:59.169299 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21ad7e40-4952-4da5-93da-8930e6333c3a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:59.170040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21ad7e40-4952-4da5-93da-8930e6333c3a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:59.341133 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-759f32de-d8a8-45cb-89bd-0c0dcb5199ed tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:59.349966 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-759f32de-d8a8-45cb-89bd-0c0dcb5199ed tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.253444 Sep 13 01:20:59.350782 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 182/362] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:59 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:20:59.540348 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-21ad7e40-4952-4da5-93da-8930e6333c3a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:59.546611 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-94290a97-ab12-41ca-b30e-16adea7bffa8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:59.547396 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-94290a97-ab12-41ca-b30e-16adea7bffa8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:59.559655 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94290a97-ab12-41ca-b30e-16adea7bffa8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:59.561367 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-21ad7e40-4952-4da5-93da-8930e6333c3a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:59.563158 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94290a97-ab12-41ca-b30e-16adea7bffa8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:59.564309 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94290a97-ab12-41ca-b30e-16adea7bffa8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:59.566842 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94290a97-ab12-41ca-b30e-16adea7bffa8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:59.567957 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-21ad7e40-4952-4da5-93da-8930e6333c3a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:59.568987 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94290a97-ab12-41ca-b30e-16adea7bffa8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:59.569979 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-94290a97-ab12-41ca-b30e-16adea7bffa8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:59.571995 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-21ad7e40-4952-4da5-93da-8930e6333c3a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1738 microversion: 2.20 time: 0.430120 Sep 13 01:20:59.572822 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 181/363] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:20:59 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1738 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:20:59.610076 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-026dd838-3813-42af-892a-ada11b03c6f2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:20:59.611173 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-026dd838-3813-42af-892a-ada11b03c6f2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:20:59.618098 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-026dd838-3813-42af-892a-ada11b03c6f2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:59.619082 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-026dd838-3813-42af-892a-ada11b03c6f2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:59.619768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-026dd838-3813-42af-892a-ada11b03c6f2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:59.620743 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-026dd838-3813-42af-892a-ada11b03c6f2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:20:59.621404 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-026dd838-3813-42af-892a-ada11b03c6f2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:20:59.624526 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-026dd838-3813-42af-892a-ada11b03c6f2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:20:59.804274 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-94290a97-ab12-41ca-b30e-16adea7bffa8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:59.819391 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-026dd838-3813-42af-892a-ada11b03c6f2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:20:59.828562 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-94290a97-ab12-41ca-b30e-16adea7bffa8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.284616 Sep 13 01:20:59.831749 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 183/364] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:59 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:20:59.833078 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-026dd838-3813-42af-892a-ada11b03c6f2 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1371 microversion: 2.1 time: 0.226800 Sep 13 01:20:59.833759 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 182/365] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:20:59 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:21:00.381881 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5d5b1fc8-fe5b-4094-83b0-ac82511b95e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:00.382442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5d5b1fc8-fe5b-4094-83b0-ac82511b95e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:00.389607 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d5b1fc8-fe5b-4094-83b0-ac82511b95e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:00.390359 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d5b1fc8-fe5b-4094-83b0-ac82511b95e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:00.390934 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d5b1fc8-fe5b-4094-83b0-ac82511b95e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:00.391899 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d5b1fc8-fe5b-4094-83b0-ac82511b95e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:00.392501 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d5b1fc8-fe5b-4094-83b0-ac82511b95e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:00.393042 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d5b1fc8-fe5b-4094-83b0-ac82511b95e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:00.538461 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5d5b1fc8-fe5b-4094-83b0-ac82511b95e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:00.547527 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5d5b1fc8-fe5b-4094-83b0-ac82511b95e8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1721 microversion: 2.1 time: 0.170961 Sep 13 01:21:00.562875 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 184/366] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:00 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:00.598596 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-da7b2bfb-9e24-4bbd-ad25-83eb751000ab tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:00.599232 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-da7b2bfb-9e24-4bbd-ad25-83eb751000ab tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:00.607456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-da7b2bfb-9e24-4bbd-ad25-83eb751000ab tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:00.608380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-da7b2bfb-9e24-4bbd-ad25-83eb751000ab tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:00.608824 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-da7b2bfb-9e24-4bbd-ad25-83eb751000ab tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:00.609528 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-da7b2bfb-9e24-4bbd-ad25-83eb751000ab tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:00.609978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-da7b2bfb-9e24-4bbd-ad25-83eb751000ab tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:00.610398 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-da7b2bfb-9e24-4bbd-ad25-83eb751000ab tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:00.820696 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-da7b2bfb-9e24-4bbd-ad25-83eb751000ab tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:00.833928 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-da7b2bfb-9e24-4bbd-ad25-83eb751000ab tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:00.835447 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-da7b2bfb-9e24-4bbd-ad25-83eb751000ab tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:00.837299 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-da7b2bfb-9e24-4bbd-ad25-83eb751000ab tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1738 microversion: 2.20 time: 0.242171 Sep 13 01:21:00.862823 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6314d62e-c3e0-4d1a-b610-24b19456a819 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:00.863639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6314d62e-c3e0-4d1a-b610-24b19456a819 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:00.866539 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 183/367] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:00 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1738 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:00.873337 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-08c3badd-b1d7-4bba-b8c5-8e3a76fec0af tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:00.875077 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6314d62e-c3e0-4d1a-b610-24b19456a819 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:00.875764 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6314d62e-c3e0-4d1a-b610-24b19456a819 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:00.876067 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-08c3badd-b1d7-4bba-b8c5-8e3a76fec0af tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:00.877041 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6314d62e-c3e0-4d1a-b610-24b19456a819 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:00.880895 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6314d62e-c3e0-4d1a-b610-24b19456a819 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:00.881530 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6314d62e-c3e0-4d1a-b610-24b19456a819 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:00.882158 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6314d62e-c3e0-4d1a-b610-24b19456a819 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:00.882907 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-08c3badd-b1d7-4bba-b8c5-8e3a76fec0af tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:00.883463 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-08c3badd-b1d7-4bba-b8c5-8e3a76fec0af tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:00.883913 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-08c3badd-b1d7-4bba-b8c5-8e3a76fec0af tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:00.885580 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-08c3badd-b1d7-4bba-b8c5-8e3a76fec0af tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:00.890995 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-08c3badd-b1d7-4bba-b8c5-8e3a76fec0af tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:00.891507 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-08c3badd-b1d7-4bba-b8c5-8e3a76fec0af tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:01.119602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6314d62e-c3e0-4d1a-b610-24b19456a819 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:01.130242 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6314d62e-c3e0-4d1a-b610-24b19456a819 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.273894 Sep 13 01:21:01.131694 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 185/368] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:00 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:01.171307 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-08c3badd-b1d7-4bba-b8c5-8e3a76fec0af tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:01.179716 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-08c3badd-b1d7-4bba-b8c5-8e3a76fec0af tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1371 microversion: 2.1 time: 0.311871 Sep 13 01:21:01.182235 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 184/369] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:00 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1371 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:01.585955 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-765b43e4-a69a-4f93-9eb7-e73c01ae63b7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:01.586882 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-765b43e4-a69a-4f93-9eb7-e73c01ae63b7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:01.597597 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-765b43e4-a69a-4f93-9eb7-e73c01ae63b7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:01.598245 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-765b43e4-a69a-4f93-9eb7-e73c01ae63b7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:01.598791 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-765b43e4-a69a-4f93-9eb7-e73c01ae63b7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:01.599652 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-765b43e4-a69a-4f93-9eb7-e73c01ae63b7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:01.600176 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-765b43e4-a69a-4f93-9eb7-e73c01ae63b7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:01.600834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-765b43e4-a69a-4f93-9eb7-e73c01ae63b7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:01.740420 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-765b43e4-a69a-4f93-9eb7-e73c01ae63b7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:01.749972 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-765b43e4-a69a-4f93-9eb7-e73c01ae63b7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1698 microversion: 2.1 time: 0.181308 Sep 13 01:21:01.750815 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 186/370] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:01 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1698 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:01.773739 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a792121a-733f-4640-8616-7c530061dace tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:01.781426 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a792121a-733f-4640-8616-7c530061dace tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:01.782115 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a792121a-733f-4640-8616-7c530061dace tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:01.785464 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a792121a-733f-4640-8616-7c530061dace tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:01.812318 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a792121a-733f-4640-8616-7c530061dace tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Going to try to start instance {{(pid=120412) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 01:21:01.862378 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a792121a-733f-4640-8616-7c530061dace tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "POST /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/action" status: 202 len: 0 microversion: 2.1 time: 0.092456 Sep 13 01:21:01.863560 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 185/371] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:21:01 2022] POST /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:21:01.865849 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e6442dee-1144-42cb-9678-cc6b8bc96076 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:01.866945 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e6442dee-1144-42cb-9678-cc6b8bc96076 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:01.872027 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c28f9585-9c51-4ef1-9b79-c3bf1935e03e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:01.872929 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c28f9585-9c51-4ef1-9b79-c3bf1935e03e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:01.873687 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6442dee-1144-42cb-9678-cc6b8bc96076 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:01.874274 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6442dee-1144-42cb-9678-cc6b8bc96076 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:01.874802 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6442dee-1144-42cb-9678-cc6b8bc96076 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:01.875756 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6442dee-1144-42cb-9678-cc6b8bc96076 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:01.876313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6442dee-1144-42cb-9678-cc6b8bc96076 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:01.876882 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e6442dee-1144-42cb-9678-cc6b8bc96076 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:01.880615 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c28f9585-9c51-4ef1-9b79-c3bf1935e03e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:01.881087 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c28f9585-9c51-4ef1-9b79-c3bf1935e03e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:01.881835 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c28f9585-9c51-4ef1-9b79-c3bf1935e03e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:01.882660 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c28f9585-9c51-4ef1-9b79-c3bf1935e03e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:01.883141 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c28f9585-9c51-4ef1-9b79-c3bf1935e03e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:01.883722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c28f9585-9c51-4ef1-9b79-c3bf1935e03e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:01.904031 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:02.069394 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e6442dee-1144-42cb-9678-cc6b8bc96076 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:02.070598 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c28f9585-9c51-4ef1-9b79-c3bf1935e03e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:02.079447 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e6442dee-1144-42cb-9678-cc6b8bc96076 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:02.080911 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e6442dee-1144-42cb-9678-cc6b8bc96076 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:02.082093 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e6442dee-1144-42cb-9678-cc6b8bc96076 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1738 microversion: 2.20 time: 0.221177 Sep 13 01:21:02.082944 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 187/372] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:01 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:21:02.089441 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c28f9585-9c51-4ef1-9b79-c3bf1935e03e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1707 microversion: 2.1 time: 0.221657 Sep 13 01:21:02.090175 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 186/373] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:01 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1707 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:21:02.155987 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-01036d11-f19b-4ac6-bec5-4c106b25c55a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:02.156621 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-01036d11-f19b-4ac6-bec5-4c106b25c55a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:02.175410 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01036d11-f19b-4ac6-bec5-4c106b25c55a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:02.175958 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01036d11-f19b-4ac6-bec5-4c106b25c55a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:02.176401 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01036d11-f19b-4ac6-bec5-4c106b25c55a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:02.177181 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01036d11-f19b-4ac6-bec5-4c106b25c55a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:02.177666 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01036d11-f19b-4ac6-bec5-4c106b25c55a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:02.178097 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-01036d11-f19b-4ac6-bec5-4c106b25c55a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:02.207945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5fd82b21-5dd2-4e0f-98ab-4f9f6402f227 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:02.208952 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-5fd82b21-5dd2-4e0f-98ab-4f9f6402f227 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:02.226106 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5fd82b21-5dd2-4e0f-98ab-4f9f6402f227 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:02.228957 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5fd82b21-5dd2-4e0f-98ab-4f9f6402f227 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:02.229420 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5fd82b21-5dd2-4e0f-98ab-4f9f6402f227 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:02.230279 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5fd82b21-5dd2-4e0f-98ab-4f9f6402f227 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:02.236299 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5fd82b21-5dd2-4e0f-98ab-4f9f6402f227 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:02.237276 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5fd82b21-5dd2-4e0f-98ab-4f9f6402f227 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:02.395120 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-01036d11-f19b-4ac6-bec5-4c106b25c55a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:02.410456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-01036d11-f19b-4ac6-bec5-4c106b25c55a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.257959 Sep 13 01:21:02.411656 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 188/374] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:02 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:02.531537 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5fd82b21-5dd2-4e0f-98ab-4f9f6402f227 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:02.543072 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-5fd82b21-5dd2-4e0f-98ab-4f9f6402f227 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1563 microversion: 2.1 time: 0.336423 Sep 13 01:21:02.559326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 187/375] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:02 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1563 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:21:02.569266 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6da552ef-ba30-49ed-96e1-cb119983f96b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:02.569812 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6da552ef-ba30-49ed-96e1-cb119983f96b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:02.581208 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6da552ef-ba30-49ed-96e1-cb119983f96b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:02.581707 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6da552ef-ba30-49ed-96e1-cb119983f96b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:02.582146 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6da552ef-ba30-49ed-96e1-cb119983f96b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:02.582877 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6da552ef-ba30-49ed-96e1-cb119983f96b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:02.583354 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6da552ef-ba30-49ed-96e1-cb119983f96b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:02.583775 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6da552ef-ba30-49ed-96e1-cb119983f96b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:02.703050 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6da552ef-ba30-49ed-96e1-cb119983f96b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.137885 Sep 13 01:21:02.705442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 189/376] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 01:21:02 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:21:03.117596 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-56a09862-effc-4ac5-9986-0bc8550a651f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:03.118248 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-56a09862-effc-4ac5-9986-0bc8550a651f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:03.125173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fe469583-15f3-40f2-8bbe-8c12adf02f58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:03.125867 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fe469583-15f3-40f2-8bbe-8c12adf02f58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:03.129666 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-56a09862-effc-4ac5-9986-0bc8550a651f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:03.130178 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-56a09862-effc-4ac5-9986-0bc8550a651f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:03.130682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-56a09862-effc-4ac5-9986-0bc8550a651f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:03.133188 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe469583-15f3-40f2-8bbe-8c12adf02f58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:03.133969 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-56a09862-effc-4ac5-9986-0bc8550a651f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:03.134481 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-56a09862-effc-4ac5-9986-0bc8550a651f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:03.134948 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-56a09862-effc-4ac5-9986-0bc8550a651f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:03.135755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe469583-15f3-40f2-8bbe-8c12adf02f58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:03.136468 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe469583-15f3-40f2-8bbe-8c12adf02f58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:03.137585 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe469583-15f3-40f2-8bbe-8c12adf02f58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:03.138134 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe469583-15f3-40f2-8bbe-8c12adf02f58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:03.138515 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe469583-15f3-40f2-8bbe-8c12adf02f58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:03.315627 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-56a09862-effc-4ac5-9986-0bc8550a651f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:03.329611 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-56a09862-effc-4ac5-9986-0bc8550a651f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:03.334026 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-56a09862-effc-4ac5-9986-0bc8550a651f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:03.335853 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-56a09862-effc-4ac5-9986-0bc8550a651f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1738 microversion: 2.20 time: 0.222301 Sep 13 01:21:03.337073 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 188/377] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:03 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:03.394758 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fe469583-15f3-40f2-8bbe-8c12adf02f58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:03.408036 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fe469583-15f3-40f2-8bbe-8c12adf02f58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1707 microversion: 2.1 time: 0.287294 Sep 13 01:21:03.409694 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 190/378] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:03 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1707 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:21:03.434184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a5247ee7-97a0-4f64-ab8e-7964acc009fe tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:03.435283 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a5247ee7-97a0-4f64-ab8e-7964acc009fe tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:03.444096 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5247ee7-97a0-4f64-ab8e-7964acc009fe tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:03.444668 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5247ee7-97a0-4f64-ab8e-7964acc009fe tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:03.445382 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5247ee7-97a0-4f64-ab8e-7964acc009fe tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:03.446410 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5247ee7-97a0-4f64-ab8e-7964acc009fe tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:03.447427 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5247ee7-97a0-4f64-ab8e-7964acc009fe tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:03.448612 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5247ee7-97a0-4f64-ab8e-7964acc009fe tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:03.629800 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a5247ee7-97a0-4f64-ab8e-7964acc009fe tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:03.639523 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a5247ee7-97a0-4f64-ab8e-7964acc009fe tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.209097 Sep 13 01:21:03.655927 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 189/379] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:03 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:04.020093 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-32609a01-58d8-489b-b52f-6725d84b93ca req-c1903c29-bdc9-4127-91ee-61fba4e0c581 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89f56d9-6326-419a-ad10-fb520d83ec2a", "tag": "d4354f6f-2db0-4d03-a3d4-4ddab59e9460"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:04.036925 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-32609a01-58d8-489b-b52f-6725d84b93ca req-c1903c29-bdc9-4127-91ee-61fba4e0c581 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:04.044898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-32609a01-58d8-489b-b52f-6725d84b93ca req-c1903c29-bdc9-4127-91ee-61fba4e0c581 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:04.045621 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-32609a01-58d8-489b-b52f-6725d84b93ca req-c1903c29-bdc9-4127-91ee-61fba4e0c581 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:04.060483 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-32609a01-58d8-489b-b52f-6725d84b93ca req-c1903c29-bdc9-4127-91ee-61fba4e0c581 service nova] Creating event network-changed:d4354f6f-2db0-4d03-a3d4-4ddab59e9460 for instance d89f56d9-6326-419a-ad10-fb520d83ec2a on hv-cinder-85694 Sep 13 01:21:04.065872 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-32609a01-58d8-489b-b52f-6725d84b93ca req-c1903c29-bdc9-4127-91ee-61fba4e0c581 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049572 Sep 13 01:21:04.066746 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 191/380] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:21:04.366015 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-737355c3-a866-4ce2-a9b9-9d27f615a91e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:04.367334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-737355c3-a866-4ce2-a9b9-9d27f615a91e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:04.379783 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-737355c3-a866-4ce2-a9b9-9d27f615a91e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:04.381986 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-737355c3-a866-4ce2-a9b9-9d27f615a91e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:04.383329 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-737355c3-a866-4ce2-a9b9-9d27f615a91e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:04.386790 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-737355c3-a866-4ce2-a9b9-9d27f615a91e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:04.387557 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-737355c3-a866-4ce2-a9b9-9d27f615a91e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:04.388223 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-737355c3-a866-4ce2-a9b9-9d27f615a91e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:04.434501 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7e661f42-c0c5-4621-ae70-e78d1fdcc243 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:04.435830 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7e661f42-c0c5-4621-ae70-e78d1fdcc243 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:04.447925 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e661f42-c0c5-4621-ae70-e78d1fdcc243 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:04.448423 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e661f42-c0c5-4621-ae70-e78d1fdcc243 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:04.448918 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e661f42-c0c5-4621-ae70-e78d1fdcc243 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:04.449577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e661f42-c0c5-4621-ae70-e78d1fdcc243 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:04.450031 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e661f42-c0c5-4621-ae70-e78d1fdcc243 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:04.450455 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e661f42-c0c5-4621-ae70-e78d1fdcc243 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:04.511092 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=4 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:04.526277 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=18 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:04.592036 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-737355c3-a866-4ce2-a9b9-9d27f615a91e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:04.608190 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-737355c3-a866-4ce2-a9b9-9d27f615a91e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:04.620096 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-737355c3-a866-4ce2-a9b9-9d27f615a91e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:04.621505 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-737355c3-a866-4ce2-a9b9-9d27f615a91e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1738 microversion: 2.20 time: 0.259653 Sep 13 01:21:04.635275 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 190/381] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:04 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1738 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:21:04.661977 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-2e401995-4870-416c-b736-563c824dbee9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:04.663015 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-2e401995-4870-416c-b736-563c824dbee9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:04.674371 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2e401995-4870-416c-b736-563c824dbee9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:04.675080 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2e401995-4870-416c-b736-563c824dbee9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:04.676731 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2e401995-4870-416c-b736-563c824dbee9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:04.677702 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2e401995-4870-416c-b736-563c824dbee9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:04.686216 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2e401995-4870-416c-b736-563c824dbee9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:04.686216 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2e401995-4870-416c-b736-563c824dbee9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:04.776171 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:05.031076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7e661f42-c0c5-4621-ae70-e78d1fdcc243 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:05.039555 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7e661f42-c0c5-4621-ae70-e78d1fdcc243 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1707 microversion: 2.1 time: 0.609622 Sep 13 01:21:05.040141 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 192/382] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:04 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1707 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:21:05.070651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2e401995-4870-416c-b736-563c824dbee9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:05.080992 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-2e401995-4870-416c-b736-563c824dbee9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.422956 Sep 13 01:21:05.082915 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 191/383] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:04 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:05.648083 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1236d7f7-7c7c-48e8-a861-0e11bb4f9810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:05.648859 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1236d7f7-7c7c-48e8-a861-0e11bb4f9810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:05.658695 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1236d7f7-7c7c-48e8-a861-0e11bb4f9810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:05.659645 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1236d7f7-7c7c-48e8-a861-0e11bb4f9810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:05.660449 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1236d7f7-7c7c-48e8-a861-0e11bb4f9810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:05.661997 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1236d7f7-7c7c-48e8-a861-0e11bb4f9810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:05.662663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1236d7f7-7c7c-48e8-a861-0e11bb4f9810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:05.663313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1236d7f7-7c7c-48e8-a861-0e11bb4f9810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:05.830661 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1236d7f7-7c7c-48e8-a861-0e11bb4f9810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:05.846306 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1236d7f7-7c7c-48e8-a861-0e11bb4f9810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:05.849323 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1236d7f7-7c7c-48e8-a861-0e11bb4f9810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:05.852075 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1236d7f7-7c7c-48e8-a861-0e11bb4f9810 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1738 microversion: 2.20 time: 0.207878 Sep 13 01:21:05.853173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 193/384] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:05 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:06.063093 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-cbecad00-bb18-43a2-a913-5337c0d35d6a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:06.064440 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-cbecad00-bb18-43a2-a913-5337c0d35d6a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:06.078068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cbecad00-bb18-43a2-a913-5337c0d35d6a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:06.078582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cbecad00-bb18-43a2-a913-5337c0d35d6a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:06.079327 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cbecad00-bb18-43a2-a913-5337c0d35d6a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:06.082598 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cbecad00-bb18-43a2-a913-5337c0d35d6a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:06.083426 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cbecad00-bb18-43a2-a913-5337c0d35d6a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:06.084028 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cbecad00-bb18-43a2-a913-5337c0d35d6a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:06.106350 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1b84cf98-25f1-4d48-9af5-490a54d5189d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:06.107111 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1b84cf98-25f1-4d48-9af5-490a54d5189d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:06.116789 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b84cf98-25f1-4d48-9af5-490a54d5189d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:06.117439 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b84cf98-25f1-4d48-9af5-490a54d5189d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:06.119682 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b84cf98-25f1-4d48-9af5-490a54d5189d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:06.120551 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b84cf98-25f1-4d48-9af5-490a54d5189d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:06.123384 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b84cf98-25f1-4d48-9af5-490a54d5189d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:06.123918 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1b84cf98-25f1-4d48-9af5-490a54d5189d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:06.327403 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-cbecad00-bb18-43a2-a913-5337c0d35d6a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:06.342018 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-cbecad00-bb18-43a2-a913-5337c0d35d6a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1711 microversion: 2.1 time: 0.283196 Sep 13 01:21:06.342687 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 192/385] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:06 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1711 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:06.390791 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1b84cf98-25f1-4d48-9af5-490a54d5189d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:06.403472 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1b84cf98-25f1-4d48-9af5-490a54d5189d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.301506 Sep 13 01:21:06.404358 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 194/386] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:06 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:06.884223 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4ecf69c7-e6d8-41cd-816a-9de98d5783dc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:06.885102 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4ecf69c7-e6d8-41cd-816a-9de98d5783dc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:06.892945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4ecf69c7-e6d8-41cd-816a-9de98d5783dc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:06.893985 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4ecf69c7-e6d8-41cd-816a-9de98d5783dc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:06.894514 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4ecf69c7-e6d8-41cd-816a-9de98d5783dc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:06.895543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4ecf69c7-e6d8-41cd-816a-9de98d5783dc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:06.896110 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4ecf69c7-e6d8-41cd-816a-9de98d5783dc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:06.896613 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4ecf69c7-e6d8-41cd-816a-9de98d5783dc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:07.084675 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4ecf69c7-e6d8-41cd-816a-9de98d5783dc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:07.096169 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4ecf69c7-e6d8-41cd-816a-9de98d5783dc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:07.098472 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4ecf69c7-e6d8-41cd-816a-9de98d5783dc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:07.099944 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4ecf69c7-e6d8-41cd-816a-9de98d5783dc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1738 microversion: 2.20 time: 0.222030 Sep 13 01:21:07.101130 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 193/387] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:06 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:07.432548 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d275a7e1-61b9-4331-b96f-e016a55e43a9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:07.433263 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d275a7e1-61b9-4331-b96f-e016a55e43a9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:07.440606 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d275a7e1-61b9-4331-b96f-e016a55e43a9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:07.441369 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d275a7e1-61b9-4331-b96f-e016a55e43a9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:07.442057 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d275a7e1-61b9-4331-b96f-e016a55e43a9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:07.443100 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d275a7e1-61b9-4331-b96f-e016a55e43a9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:07.443770 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d275a7e1-61b9-4331-b96f-e016a55e43a9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:07.444404 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d275a7e1-61b9-4331-b96f-e016a55e43a9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:07.594490 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d275a7e1-61b9-4331-b96f-e016a55e43a9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:07.609225 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d275a7e1-61b9-4331-b96f-e016a55e43a9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.181081 Sep 13 01:21:07.609949 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 195/388] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:07 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:08.126073 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-77ce1d0a-02b8-4c24-b682-7b6a32e46f94 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:08.126672 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-77ce1d0a-02b8-4c24-b682-7b6a32e46f94 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:08.132800 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-77ce1d0a-02b8-4c24-b682-7b6a32e46f94 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:08.133280 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-77ce1d0a-02b8-4c24-b682-7b6a32e46f94 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:08.133709 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-77ce1d0a-02b8-4c24-b682-7b6a32e46f94 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:08.134424 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-77ce1d0a-02b8-4c24-b682-7b6a32e46f94 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:08.134897 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-77ce1d0a-02b8-4c24-b682-7b6a32e46f94 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:08.135318 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-77ce1d0a-02b8-4c24-b682-7b6a32e46f94 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:08.281753 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-77ce1d0a-02b8-4c24-b682-7b6a32e46f94 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:08.290430 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-77ce1d0a-02b8-4c24-b682-7b6a32e46f94 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:08.292846 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-77ce1d0a-02b8-4c24-b682-7b6a32e46f94 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:08.294161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-77ce1d0a-02b8-4c24-b682-7b6a32e46f94 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1738 microversion: 2.20 time: 0.172128 Sep 13 01:21:08.295005 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 194/389] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:08 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1738 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:08.636611 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b9fcea64-8c10-4dab-9ebb-69d750b06271 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:08.637244 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b9fcea64-8c10-4dab-9ebb-69d750b06271 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:08.644575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b9fcea64-8c10-4dab-9ebb-69d750b06271 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:08.645145 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b9fcea64-8c10-4dab-9ebb-69d750b06271 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:08.645586 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b9fcea64-8c10-4dab-9ebb-69d750b06271 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:08.646300 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b9fcea64-8c10-4dab-9ebb-69d750b06271 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:08.646747 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b9fcea64-8c10-4dab-9ebb-69d750b06271 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:08.647209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b9fcea64-8c10-4dab-9ebb-69d750b06271 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:08.666222 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:08.799808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b9fcea64-8c10-4dab-9ebb-69d750b06271 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:08.808860 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b9fcea64-8c10-4dab-9ebb-69d750b06271 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.176863 Sep 13 01:21:08.810226 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 196/390] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:08 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:21:09.319997 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ed59d33e-58af-457d-a477-6487241b25ca tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:09.320658 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ed59d33e-58af-457d-a477-6487241b25ca tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:09.327478 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed59d33e-58af-457d-a477-6487241b25ca tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:09.327975 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed59d33e-58af-457d-a477-6487241b25ca tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:09.328415 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed59d33e-58af-457d-a477-6487241b25ca tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:09.329133 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed59d33e-58af-457d-a477-6487241b25ca tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:09.329598 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed59d33e-58af-457d-a477-6487241b25ca tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:09.330028 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed59d33e-58af-457d-a477-6487241b25ca tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:09.488545 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ed59d33e-58af-457d-a477-6487241b25ca tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:09.500369 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ed59d33e-58af-457d-a477-6487241b25ca tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:09.502527 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ed59d33e-58af-457d-a477-6487241b25ca tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:09.505123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ed59d33e-58af-457d-a477-6487241b25ca tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1738 microversion: 2.20 time: 0.189070 Sep 13 01:21:09.506098 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 195/391] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:09 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:09.832968 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-37b4b94f-0603-4e19-bbef-439c2d0d36ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:09.833582 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-37b4b94f-0603-4e19-bbef-439c2d0d36ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:09.839976 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37b4b94f-0603-4e19-bbef-439c2d0d36ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:09.840462 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37b4b94f-0603-4e19-bbef-439c2d0d36ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:09.840898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37b4b94f-0603-4e19-bbef-439c2d0d36ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:09.841589 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37b4b94f-0603-4e19-bbef-439c2d0d36ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:09.842042 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37b4b94f-0603-4e19-bbef-439c2d0d36ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:09.842463 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37b4b94f-0603-4e19-bbef-439c2d0d36ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:09.968171 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-37b4b94f-0603-4e19-bbef-439c2d0d36ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:09.975862 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-37b4b94f-0603-4e19-bbef-439c2d0d36ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.146837 Sep 13 01:21:09.976424 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 197/392] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:09 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:10.531925 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-6fb99c05-c16a-43fa-9314-9bb376834ef7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:10.532532 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-6fb99c05-c16a-43fa-9314-9bb376834ef7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:10.538846 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6fb99c05-c16a-43fa-9314-9bb376834ef7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:10.539360 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6fb99c05-c16a-43fa-9314-9bb376834ef7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:10.539796 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6fb99c05-c16a-43fa-9314-9bb376834ef7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:10.541197 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6fb99c05-c16a-43fa-9314-9bb376834ef7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:10.541651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6fb99c05-c16a-43fa-9314-9bb376834ef7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:10.542075 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6fb99c05-c16a-43fa-9314-9bb376834ef7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:10.733543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6fb99c05-c16a-43fa-9314-9bb376834ef7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:10.742297 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6fb99c05-c16a-43fa-9314-9bb376834ef7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:10.744086 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6fb99c05-c16a-43fa-9314-9bb376834ef7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:10.745342 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-6fb99c05-c16a-43fa-9314-9bb376834ef7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1720 microversion: 2.20 time: 0.217410 Sep 13 01:21:10.746028 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 196/393] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:10 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:10.835273 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-235dc449-82b0-4401-bb44-6a8274a390db req-d1022ec5-2075-44ec-96dd-d6445ef87760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8555c188-5c8f-4a84-877b-c97fe0265c5c", "name": "network-vif-plugged", "status": "completed", "tag": "6c6841ec-d12a-4293-a896-c6083998f37f"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:10.846531 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-235dc449-82b0-4401-bb44-6a8274a390db req-d1022ec5-2075-44ec-96dd-d6445ef87760 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:10.847138 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-235dc449-82b0-4401-bb44-6a8274a390db req-d1022ec5-2075-44ec-96dd-d6445ef87760 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:10.847577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-235dc449-82b0-4401-bb44-6a8274a390db req-d1022ec5-2075-44ec-96dd-d6445ef87760 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:10.859230 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-235dc449-82b0-4401-bb44-6a8274a390db req-d1022ec5-2075-44ec-96dd-d6445ef87760 service nova] Creating event network-vif-plugged:6c6841ec-d12a-4293-a896-c6083998f37f for instance 8555c188-5c8f-4a84-877b-c97fe0265c5c on hv-cinder-85694 Sep 13 01:21:10.863996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-235dc449-82b0-4401-bb44-6a8274a390db req-d1022ec5-2075-44ec-96dd-d6445ef87760 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032404 Sep 13 01:21:10.864581 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 198/394] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:21:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:21:10.998707 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a4f6152a-fe0d-45d7-a5ba-09f9a013f0fc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:10.999373 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a4f6152a-fe0d-45d7-a5ba-09f9a013f0fc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:11.005277 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a4f6152a-fe0d-45d7-a5ba-09f9a013f0fc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:11.005768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a4f6152a-fe0d-45d7-a5ba-09f9a013f0fc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:11.006209 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a4f6152a-fe0d-45d7-a5ba-09f9a013f0fc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:11.006934 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a4f6152a-fe0d-45d7-a5ba-09f9a013f0fc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:11.007396 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a4f6152a-fe0d-45d7-a5ba-09f9a013f0fc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:11.007823 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a4f6152a-fe0d-45d7-a5ba-09f9a013f0fc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:11.144775 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a4f6152a-fe0d-45d7-a5ba-09f9a013f0fc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:11.152939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a4f6152a-fe0d-45d7-a5ba-09f9a013f0fc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.158208 Sep 13 01:21:11.153503 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 197/395] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:10 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:11.770752 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4d95c92e-b243-436c-8851-ede2394760ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:11.771468 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4d95c92e-b243-436c-8851-ede2394760ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:11.777525 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d95c92e-b243-436c-8851-ede2394760ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:11.778005 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d95c92e-b243-436c-8851-ede2394760ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:11.778440 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d95c92e-b243-436c-8851-ede2394760ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:11.779157 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d95c92e-b243-436c-8851-ede2394760ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:11.779611 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d95c92e-b243-436c-8851-ede2394760ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:11.780034 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d95c92e-b243-436c-8851-ede2394760ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:11.908488 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4d95c92e-b243-436c-8851-ede2394760ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:11.916936 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4d95c92e-b243-436c-8851-ede2394760ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:11.918423 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4d95c92e-b243-436c-8851-ede2394760ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:11.919550 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4d95c92e-b243-436c-8851-ede2394760ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1720 microversion: 2.20 time: 0.153126 Sep 13 01:21:11.920102 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 199/396] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:11 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:12.175272 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-006f208c-6a4a-4ca3-b7e5-d7f3235e4592 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:12.175817 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-006f208c-6a4a-4ca3-b7e5-d7f3235e4592 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:12.182679 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-006f208c-6a4a-4ca3-b7e5-d7f3235e4592 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:12.183187 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-006f208c-6a4a-4ca3-b7e5-d7f3235e4592 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:12.183622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-006f208c-6a4a-4ca3-b7e5-d7f3235e4592 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:12.184301 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-006f208c-6a4a-4ca3-b7e5-d7f3235e4592 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:12.185064 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-006f208c-6a4a-4ca3-b7e5-d7f3235e4592 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:12.185430 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-006f208c-6a4a-4ca3-b7e5-d7f3235e4592 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:12.311413 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-006f208c-6a4a-4ca3-b7e5-d7f3235e4592 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:12.319075 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-006f208c-6a4a-4ca3-b7e5-d7f3235e4592 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.147578 Sep 13 01:21:12.319646 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 198/397] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:12 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:12.944355 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9580802d-51d7-41e8-a8b1-06a704a20939 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:12.946084 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9580802d-51d7-41e8-a8b1-06a704a20939 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:12.952978 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9580802d-51d7-41e8-a8b1-06a704a20939 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:12.953468 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9580802d-51d7-41e8-a8b1-06a704a20939 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:12.953908 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9580802d-51d7-41e8-a8b1-06a704a20939 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:12.954622 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9580802d-51d7-41e8-a8b1-06a704a20939 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:12.955113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9580802d-51d7-41e8-a8b1-06a704a20939 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:12.955543 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9580802d-51d7-41e8-a8b1-06a704a20939 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:13.081770 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9580802d-51d7-41e8-a8b1-06a704a20939 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:13.090250 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9580802d-51d7-41e8-a8b1-06a704a20939 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:13.091706 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9580802d-51d7-41e8-a8b1-06a704a20939 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:13.092855 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9580802d-51d7-41e8-a8b1-06a704a20939 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1723 microversion: 2.20 time: 0.152400 Sep 13 01:21:13.093406 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 200/398] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:12 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:13.117632 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-46badc09-b233-49ff-9429-751c4bf7b9d3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "394264f5-b7be-4aa2-a951-01e3ec62450e"}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:13.120347 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-46badc09-b233-49ff-9429-751c4bf7b9d3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:13.126611 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46badc09-b233-49ff-9429-751c4bf7b9d3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:13.127138 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46badc09-b233-49ff-9429-751c4bf7b9d3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:13.127570 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46badc09-b233-49ff-9429-751c4bf7b9d3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:13.128260 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46badc09-b233-49ff-9429-751c4bf7b9d3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:13.128709 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46badc09-b233-49ff-9429-751c4bf7b9d3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:13.129157 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46badc09-b233-49ff-9429-751c4bf7b9d3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:13.342088 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bf8c95bd-6d36-40da-8e56-7c8cb39a3f59 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:13.342807 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bf8c95bd-6d36-40da-8e56-7c8cb39a3f59 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:13.350700 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf8c95bd-6d36-40da-8e56-7c8cb39a3f59 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:13.351126 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf8c95bd-6d36-40da-8e56-7c8cb39a3f59 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:13.351563 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf8c95bd-6d36-40da-8e56-7c8cb39a3f59 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:13.352443 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf8c95bd-6d36-40da-8e56-7c8cb39a3f59 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:13.353345 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf8c95bd-6d36-40da-8e56-7c8cb39a3f59 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:13.353773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf8c95bd-6d36-40da-8e56-7c8cb39a3f59 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:13.428126 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-46badc09-b233-49ff-9429-751c4bf7b9d3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "POST /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.314771 Sep 13 01:21:13.428810 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 199/399] 10.222.0.15 () {62 vars in 1364 bytes} [Tue Sep 13 01:21:13 2022] POST /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/os-volume_attachments => generated 188 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:21:13.498480 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bf8c95bd-6d36-40da-8e56-7c8cb39a3f59 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:13.506440 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bf8c95bd-6d36-40da-8e56-7c8cb39a3f59 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1265 microversion: 2.1 time: 0.168369 Sep 13 01:21:13.507029 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 201/400] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:13 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:13.553828 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-92a96bca-fedf-4947-a645-66467054ed83 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:13.554418 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-92a96bca-fedf-4947-a645-66467054ed83 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:13.561232 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-92a96bca-fedf-4947-a645-66467054ed83 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:13.561710 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-92a96bca-fedf-4947-a645-66467054ed83 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:13.562140 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-92a96bca-fedf-4947-a645-66467054ed83 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:13.562828 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-92a96bca-fedf-4947-a645-66467054ed83 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:13.563295 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-92a96bca-fedf-4947-a645-66467054ed83 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:13.563709 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-92a96bca-fedf-4947-a645-66467054ed83 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:13.581374 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:13.610823 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-92a96bca-fedf-4947-a645-66467054ed83 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120412) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 01:21:13.675468 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-92a96bca-fedf-4947-a645-66467054ed83 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "POST /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/action" status: 202 len: 0 microversion: 2.20 time: 0.125486 Sep 13 01:21:13.676103 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 200/401] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Sep 13 01:21:13 2022] POST /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:21:13.684649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8b877c2d-cec4-4049-bbd8-365e118b5074 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:13.685528 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8b877c2d-cec4-4049-bbd8-365e118b5074 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:13.691447 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8b877c2d-cec4-4049-bbd8-365e118b5074 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:13.691931 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8b877c2d-cec4-4049-bbd8-365e118b5074 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:13.692386 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8b877c2d-cec4-4049-bbd8-365e118b5074 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:13.693068 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8b877c2d-cec4-4049-bbd8-365e118b5074 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:13.693526 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8b877c2d-cec4-4049-bbd8-365e118b5074 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:13.693956 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8b877c2d-cec4-4049-bbd8-365e118b5074 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:13.824277 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8b877c2d-cec4-4049-bbd8-365e118b5074 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:13.833071 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8b877c2d-cec4-4049-bbd8-365e118b5074 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:13.834525 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8b877c2d-cec4-4049-bbd8-365e118b5074 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:13.835718 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8b877c2d-cec4-4049-bbd8-365e118b5074 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1809 microversion: 2.20 time: 0.155490 Sep 13 01:21:13.836271 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 202/402] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:13 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:14.530891 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-aaeb4446-0a18-496d-b300-9b234e70e9fa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:14.531508 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-aaeb4446-0a18-496d-b300-9b234e70e9fa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:14.537384 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aaeb4446-0a18-496d-b300-9b234e70e9fa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:14.537864 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aaeb4446-0a18-496d-b300-9b234e70e9fa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:14.538297 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aaeb4446-0a18-496d-b300-9b234e70e9fa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:14.539021 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aaeb4446-0a18-496d-b300-9b234e70e9fa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:14.539472 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aaeb4446-0a18-496d-b300-9b234e70e9fa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:14.539892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-aaeb4446-0a18-496d-b300-9b234e70e9fa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:14.671316 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-aaeb4446-0a18-496d-b300-9b234e70e9fa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:14.679619 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-aaeb4446-0a18-496d-b300-9b234e70e9fa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1453 microversion: 2.1 time: 0.153537 Sep 13 01:21:14.680486 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 201/403] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:14 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:14.703041 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0626930f-e583-40dd-b593-dfb603495862 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:14.703975 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0626930f-e583-40dd-b593-dfb603495862 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:14.710953 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0626930f-e583-40dd-b593-dfb603495862 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:14.712183 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0626930f-e583-40dd-b593-dfb603495862 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:14.712627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0626930f-e583-40dd-b593-dfb603495862 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:14.713680 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0626930f-e583-40dd-b593-dfb603495862 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:14.714150 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0626930f-e583-40dd-b593-dfb603495862 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:14.714579 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0626930f-e583-40dd-b593-dfb603495862 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:14.803189 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-1ec8cc63-0808-416f-8275-dd487c93ec60 req-f8ace73e-af7c-4e20-a74f-883003f7e0f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1677b90a-17f0-496f-8fce-ac573509c1ac", "name": "network-vif-unplugged", "status": "completed", "tag": "88cd16db-1d4f-46f0-9069-3f6713e3efbd"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:14.813842 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-1ec8cc63-0808-416f-8275-dd487c93ec60 req-f8ace73e-af7c-4e20-a74f-883003f7e0f9 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:14.814747 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-1ec8cc63-0808-416f-8275-dd487c93ec60 req-f8ace73e-af7c-4e20-a74f-883003f7e0f9 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:14.815403 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-1ec8cc63-0808-416f-8275-dd487c93ec60 req-f8ace73e-af7c-4e20-a74f-883003f7e0f9 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:14.829333 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.compute.server_external_events [req-1ec8cc63-0808-416f-8275-dd487c93ec60 req-f8ace73e-af7c-4e20-a74f-883003f7e0f9 service nova] Unable to find a host for instance 1677b90a-17f0-496f-8fce-ac573509c1ac. Dropping event network-vif-unplugged {{(pid=120412) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 13 01:21:14.830631 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-1ec8cc63-0808-416f-8275-dd487c93ec60 req-f8ace73e-af7c-4e20-a74f-883003f7e0f9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031543 Sep 13 01:21:14.831436 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 202/404] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:21:14 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 13 01:21:14.861600 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-46af7b16-b116-49f5-bc4c-3ef03768093e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:14.862226 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-46af7b16-b116-49f5-bc4c-3ef03768093e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:14.868489 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46af7b16-b116-49f5-bc4c-3ef03768093e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:14.869275 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46af7b16-b116-49f5-bc4c-3ef03768093e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:14.869947 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46af7b16-b116-49f5-bc4c-3ef03768093e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:14.870900 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46af7b16-b116-49f5-bc4c-3ef03768093e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:14.871839 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46af7b16-b116-49f5-bc4c-3ef03768093e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:14.872277 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46af7b16-b116-49f5-bc4c-3ef03768093e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:14.873803 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0626930f-e583-40dd-b593-dfb603495862 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:14.893411 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0626930f-e583-40dd-b593-dfb603495862 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1453 microversion: 2.1 time: 0.194439 Sep 13 01:21:14.894783 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 203/405] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:14 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1453 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:15.061355 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-46af7b16-b116-49f5-bc4c-3ef03768093e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:15.070746 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-46af7b16-b116-49f5-bc4c-3ef03768093e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:15.072817 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-46af7b16-b116-49f5-bc4c-3ef03768093e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:15.073995 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-46af7b16-b116-49f5-bc4c-3ef03768093e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1749 microversion: 2.20 time: 0.216306 Sep 13 01:21:15.074761 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 203/406] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:14 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1749 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:21:16.101037 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b81f1304-b276-4b25-982c-595db7a06e29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:16.102993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b81f1304-b276-4b25-982c-595db7a06e29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:16.110948 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b81f1304-b276-4b25-982c-595db7a06e29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:16.112115 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b81f1304-b276-4b25-982c-595db7a06e29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:16.113016 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b81f1304-b276-4b25-982c-595db7a06e29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:16.114314 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b81f1304-b276-4b25-982c-595db7a06e29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:16.115275 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b81f1304-b276-4b25-982c-595db7a06e29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:16.116043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b81f1304-b276-4b25-982c-595db7a06e29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:16.353685 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b81f1304-b276-4b25-982c-595db7a06e29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:16.362130 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b81f1304-b276-4b25-982c-595db7a06e29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:16.363607 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b81f1304-b276-4b25-982c-595db7a06e29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:16.364762 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b81f1304-b276-4b25-982c-595db7a06e29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.267973 Sep 13 01:21:16.365312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 204/407] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:16 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:16.722596 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-13a44f6f-9814-4b81-b68b-9684113d09a7 req-f17e68db-0741-4800-9134-4dba072a0aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8555c188-5c8f-4a84-877b-c97fe0265c5c", "tag": "6c6841ec-d12a-4293-a896-c6083998f37f"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:16.732346 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-13a44f6f-9814-4b81-b68b-9684113d09a7 req-f17e68db-0741-4800-9134-4dba072a0aa0 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:16.732817 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-13a44f6f-9814-4b81-b68b-9684113d09a7 req-f17e68db-0741-4800-9134-4dba072a0aa0 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:16.733457 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-13a44f6f-9814-4b81-b68b-9684113d09a7 req-f17e68db-0741-4800-9134-4dba072a0aa0 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:16.744728 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-13a44f6f-9814-4b81-b68b-9684113d09a7 req-f17e68db-0741-4800-9134-4dba072a0aa0 service nova] Creating event network-changed:6c6841ec-d12a-4293-a896-c6083998f37f for instance 8555c188-5c8f-4a84-877b-c97fe0265c5c on hv-cinder-85694 Sep 13 01:21:16.750019 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-13a44f6f-9814-4b81-b68b-9684113d09a7 req-f17e68db-0741-4800-9134-4dba072a0aa0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030944 Sep 13 01:21:16.750841 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 204/408] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:21:17.390547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f59e50db-2fd7-4a14-99cd-4592bb1a186e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:17.391336 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f59e50db-2fd7-4a14-99cd-4592bb1a186e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:17.405639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f59e50db-2fd7-4a14-99cd-4592bb1a186e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:17.406461 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f59e50db-2fd7-4a14-99cd-4592bb1a186e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:17.407223 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f59e50db-2fd7-4a14-99cd-4592bb1a186e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:17.408148 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f59e50db-2fd7-4a14-99cd-4592bb1a186e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:17.408792 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f59e50db-2fd7-4a14-99cd-4592bb1a186e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:17.409373 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f59e50db-2fd7-4a14-99cd-4592bb1a186e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:17.559055 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f59e50db-2fd7-4a14-99cd-4592bb1a186e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:17.568073 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f59e50db-2fd7-4a14-99cd-4592bb1a186e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:17.569504 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f59e50db-2fd7-4a14-99cd-4592bb1a186e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:17.571531 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f59e50db-2fd7-4a14-99cd-4592bb1a186e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.184743 Sep 13 01:21:17.572876 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 205/409] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:17 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:18.601088 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5a2605a3-011f-405f-8b36-e16706d40d14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:18.601785 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-5a2605a3-011f-405f-8b36-e16706d40d14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:18.608566 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5a2605a3-011f-405f-8b36-e16706d40d14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:18.609050 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5a2605a3-011f-405f-8b36-e16706d40d14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:18.609488 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5a2605a3-011f-405f-8b36-e16706d40d14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:18.610183 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5a2605a3-011f-405f-8b36-e16706d40d14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:18.610639 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5a2605a3-011f-405f-8b36-e16706d40d14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:18.611095 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5a2605a3-011f-405f-8b36-e16706d40d14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:18.746419 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5a2605a3-011f-405f-8b36-e16706d40d14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:18.756124 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5a2605a3-011f-405f-8b36-e16706d40d14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:18.757570 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5a2605a3-011f-405f-8b36-e16706d40d14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:18.759305 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-5a2605a3-011f-405f-8b36-e16706d40d14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.163022 Sep 13 01:21:18.759885 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 205/410] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:18 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:19.784264 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5b9a1c31-cb67-47c6-8cf6-2e66650b6690 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:19.784895 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5b9a1c31-cb67-47c6-8cf6-2e66650b6690 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:19.792254 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b9a1c31-cb67-47c6-8cf6-2e66650b6690 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:19.792751 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b9a1c31-cb67-47c6-8cf6-2e66650b6690 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:19.793191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b9a1c31-cb67-47c6-8cf6-2e66650b6690 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:19.793900 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b9a1c31-cb67-47c6-8cf6-2e66650b6690 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:19.794358 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b9a1c31-cb67-47c6-8cf6-2e66650b6690 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:19.794780 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5b9a1c31-cb67-47c6-8cf6-2e66650b6690 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:19.930946 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5b9a1c31-cb67-47c6-8cf6-2e66650b6690 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:19.941247 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5b9a1c31-cb67-47c6-8cf6-2e66650b6690 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:19.943271 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5b9a1c31-cb67-47c6-8cf6-2e66650b6690 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:19.944628 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5b9a1c31-cb67-47c6-8cf6-2e66650b6690 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.164590 Sep 13 01:21:19.945333 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 206/411] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:19 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:20.970778 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d8728ac9-6ed4-47c2-a08b-a37900b8c9b4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:20.971433 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d8728ac9-6ed4-47c2-a08b-a37900b8c9b4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:20.977827 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d8728ac9-6ed4-47c2-a08b-a37900b8c9b4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:20.978319 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d8728ac9-6ed4-47c2-a08b-a37900b8c9b4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:20.979762 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d8728ac9-6ed4-47c2-a08b-a37900b8c9b4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:20.979762 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d8728ac9-6ed4-47c2-a08b-a37900b8c9b4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:20.980093 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d8728ac9-6ed4-47c2-a08b-a37900b8c9b4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:20.980315 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d8728ac9-6ed4-47c2-a08b-a37900b8c9b4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:21.114187 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d8728ac9-6ed4-47c2-a08b-a37900b8c9b4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:21.123338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d8728ac9-6ed4-47c2-a08b-a37900b8c9b4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:21.124773 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d8728ac9-6ed4-47c2-a08b-a37900b8c9b4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:21.125946 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d8728ac9-6ed4-47c2-a08b-a37900b8c9b4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.159276 Sep 13 01:21:21.126670 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 206/412] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:20 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:22.152530 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-307dcff7-30cf-4199-b2e5-86b664e70cd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:22.153143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-307dcff7-30cf-4199-b2e5-86b664e70cd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:22.159662 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-307dcff7-30cf-4199-b2e5-86b664e70cd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:22.160385 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-307dcff7-30cf-4199-b2e5-86b664e70cd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:22.160982 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-307dcff7-30cf-4199-b2e5-86b664e70cd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:22.161866 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-307dcff7-30cf-4199-b2e5-86b664e70cd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:22.162473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-307dcff7-30cf-4199-b2e5-86b664e70cd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:22.163073 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-307dcff7-30cf-4199-b2e5-86b664e70cd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:22.295385 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-307dcff7-30cf-4199-b2e5-86b664e70cd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:22.304288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-307dcff7-30cf-4199-b2e5-86b664e70cd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:22.306266 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-307dcff7-30cf-4199-b2e5-86b664e70cd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:22.307519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-307dcff7-30cf-4199-b2e5-86b664e70cd7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.158904 Sep 13 01:21:22.308407 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 207/413] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:22 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:21:23.333002 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ae6968d8-6974-422c-94cf-52151c181550 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:23.333619 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ae6968d8-6974-422c-94cf-52151c181550 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:23.340754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ae6968d8-6974-422c-94cf-52151c181550 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:23.341234 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ae6968d8-6974-422c-94cf-52151c181550 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:23.341696 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ae6968d8-6974-422c-94cf-52151c181550 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:23.342408 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ae6968d8-6974-422c-94cf-52151c181550 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:23.342874 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ae6968d8-6974-422c-94cf-52151c181550 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:23.343302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ae6968d8-6974-422c-94cf-52151c181550 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:23.477737 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ae6968d8-6974-422c-94cf-52151c181550 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:23.488107 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ae6968d8-6974-422c-94cf-52151c181550 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:23.489537 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ae6968d8-6974-422c-94cf-52151c181550 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:23.490791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ae6968d8-6974-422c-94cf-52151c181550 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.161603 Sep 13 01:21:23.491395 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 207/414] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:23 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:24.517672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b26b056d-ff6f-43dc-b034-b905f09f8ff1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:24.518407 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b26b056d-ff6f-43dc-b034-b905f09f8ff1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:24.524971 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b26b056d-ff6f-43dc-b034-b905f09f8ff1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:24.525387 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b26b056d-ff6f-43dc-b034-b905f09f8ff1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:24.525817 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b26b056d-ff6f-43dc-b034-b905f09f8ff1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:24.527061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b26b056d-ff6f-43dc-b034-b905f09f8ff1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:24.527514 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b26b056d-ff6f-43dc-b034-b905f09f8ff1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:24.527932 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b26b056d-ff6f-43dc-b034-b905f09f8ff1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:24.664947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b26b056d-ff6f-43dc-b034-b905f09f8ff1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:24.677125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b26b056d-ff6f-43dc-b034-b905f09f8ff1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:24.678582 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b26b056d-ff6f-43dc-b034-b905f09f8ff1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:24.680172 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b26b056d-ff6f-43dc-b034-b905f09f8ff1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.166896 Sep 13 01:21:24.680737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 208/415] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:24 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:25.705373 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-26fda6ac-bd81-425b-85a5-38db3ee7c0b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:25.705938 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-26fda6ac-bd81-425b-85a5-38db3ee7c0b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:25.712351 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-26fda6ac-bd81-425b-85a5-38db3ee7c0b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:25.712827 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-26fda6ac-bd81-425b-85a5-38db3ee7c0b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:25.713256 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-26fda6ac-bd81-425b-85a5-38db3ee7c0b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:25.713966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-26fda6ac-bd81-425b-85a5-38db3ee7c0b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:25.714459 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-26fda6ac-bd81-425b-85a5-38db3ee7c0b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:25.714900 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-26fda6ac-bd81-425b-85a5-38db3ee7c0b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:25.847752 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-26fda6ac-bd81-425b-85a5-38db3ee7c0b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:25.857969 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-26fda6ac-bd81-425b-85a5-38db3ee7c0b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:25.859765 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-26fda6ac-bd81-425b-85a5-38db3ee7c0b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:25.860936 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-26fda6ac-bd81-425b-85a5-38db3ee7c0b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.159532 Sep 13 01:21:25.861869 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 208/416] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:25 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:26.888818 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2155c892-6f96-4966-800c-dc783e51bb71 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:26.890322 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2155c892-6f96-4966-800c-dc783e51bb71 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:26.897238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=70 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:26.898801 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2155c892-6f96-4966-800c-dc783e51bb71 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:26.899374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2155c892-6f96-4966-800c-dc783e51bb71 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:26.899870 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2155c892-6f96-4966-800c-dc783e51bb71 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:26.900790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2155c892-6f96-4966-800c-dc783e51bb71 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:26.901273 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2155c892-6f96-4966-800c-dc783e51bb71 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:26.901701 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2155c892-6f96-4966-800c-dc783e51bb71 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:27.036490 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2155c892-6f96-4966-800c-dc783e51bb71 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:27.045826 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2155c892-6f96-4966-800c-dc783e51bb71 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:27.047299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2155c892-6f96-4966-800c-dc783e51bb71 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:27.048467 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2155c892-6f96-4966-800c-dc783e51bb71 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.163993 Sep 13 01:21:27.049235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 209/417] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:26 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:28.073669 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ef550464-78d5-4df7-bd77-00900c15fee6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:28.074303 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ef550464-78d5-4df7-bd77-00900c15fee6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:28.081276 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ef550464-78d5-4df7-bd77-00900c15fee6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:28.081752 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ef550464-78d5-4df7-bd77-00900c15fee6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:28.082178 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ef550464-78d5-4df7-bd77-00900c15fee6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:28.082894 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ef550464-78d5-4df7-bd77-00900c15fee6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:28.083344 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ef550464-78d5-4df7-bd77-00900c15fee6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:28.083760 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ef550464-78d5-4df7-bd77-00900c15fee6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:28.224001 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ef550464-78d5-4df7-bd77-00900c15fee6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:28.234098 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ef550464-78d5-4df7-bd77-00900c15fee6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:28.235573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ef550464-78d5-4df7-bd77-00900c15fee6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:28.236858 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ef550464-78d5-4df7-bd77-00900c15fee6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.167147 Sep 13 01:21:28.237681 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 209/418] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:28 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:29.262618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e7af499c-f309-496c-aad7-e6b020b482a3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:29.263794 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e7af499c-f309-496c-aad7-e6b020b482a3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:29.270456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e7af499c-f309-496c-aad7-e6b020b482a3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:29.270977 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e7af499c-f309-496c-aad7-e6b020b482a3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:29.271424 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e7af499c-f309-496c-aad7-e6b020b482a3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:29.272132 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e7af499c-f309-496c-aad7-e6b020b482a3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:29.272589 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e7af499c-f309-496c-aad7-e6b020b482a3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:29.273018 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e7af499c-f309-496c-aad7-e6b020b482a3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:29.404353 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e7af499c-f309-496c-aad7-e6b020b482a3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:29.413496 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e7af499c-f309-496c-aad7-e6b020b482a3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:29.414762 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e7af499c-f309-496c-aad7-e6b020b482a3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:29.415961 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e7af499c-f309-496c-aad7-e6b020b482a3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.157237 Sep 13 01:21:29.416520 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 210/419] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:29 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:30.440960 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-76b2690d-1436-4b11-8e65-0b6313b0989f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:30.441579 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-76b2690d-1436-4b11-8e65-0b6313b0989f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:30.443803 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:30.449366 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-76b2690d-1436-4b11-8e65-0b6313b0989f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:30.449850 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-76b2690d-1436-4b11-8e65-0b6313b0989f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:30.450284 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-76b2690d-1436-4b11-8e65-0b6313b0989f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:30.451005 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-76b2690d-1436-4b11-8e65-0b6313b0989f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:30.451474 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-76b2690d-1436-4b11-8e65-0b6313b0989f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:30.451915 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-76b2690d-1436-4b11-8e65-0b6313b0989f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:30.579590 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-76b2690d-1436-4b11-8e65-0b6313b0989f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:30.587969 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-76b2690d-1436-4b11-8e65-0b6313b0989f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:30.589401 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-76b2690d-1436-4b11-8e65-0b6313b0989f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:30.590548 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-76b2690d-1436-4b11-8e65-0b6313b0989f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.153589 Sep 13 01:21:30.591682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 210/420] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:30 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:31.616037 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6675a633-c9ba-4fe6-81ab-a04436403310 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:31.616647 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6675a633-c9ba-4fe6-81ab-a04436403310 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:31.623035 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6675a633-c9ba-4fe6-81ab-a04436403310 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:31.623527 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6675a633-c9ba-4fe6-81ab-a04436403310 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:31.623958 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6675a633-c9ba-4fe6-81ab-a04436403310 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:31.624648 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6675a633-c9ba-4fe6-81ab-a04436403310 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:31.625099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6675a633-c9ba-4fe6-81ab-a04436403310 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:31.625522 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6675a633-c9ba-4fe6-81ab-a04436403310 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:31.754604 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6675a633-c9ba-4fe6-81ab-a04436403310 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:31.763223 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6675a633-c9ba-4fe6-81ab-a04436403310 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:31.764670 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6675a633-c9ba-4fe6-81ab-a04436403310 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:31.765829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6675a633-c9ba-4fe6-81ab-a04436403310 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.153715 Sep 13 01:21:31.766376 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 211/421] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:31 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:32.791090 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c80ebb4e-86ac-4c4c-b53c-cf9a571de796 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:32.791704 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c80ebb4e-86ac-4c4c-b53c-cf9a571de796 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:32.798649 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c80ebb4e-86ac-4c4c-b53c-cf9a571de796 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:32.799161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c80ebb4e-86ac-4c4c-b53c-cf9a571de796 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:32.799600 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c80ebb4e-86ac-4c4c-b53c-cf9a571de796 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:32.800294 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c80ebb4e-86ac-4c4c-b53c-cf9a571de796 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:32.800748 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c80ebb4e-86ac-4c4c-b53c-cf9a571de796 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:32.801173 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c80ebb4e-86ac-4c4c-b53c-cf9a571de796 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:32.925787 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c80ebb4e-86ac-4c4c-b53c-cf9a571de796 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:32.934322 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c80ebb4e-86ac-4c4c-b53c-cf9a571de796 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:32.936594 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c80ebb4e-86ac-4c4c-b53c-cf9a571de796 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:32.937756 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c80ebb4e-86ac-4c4c-b53c-cf9a571de796 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.150664 Sep 13 01:21:32.938317 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 211/422] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:32 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:33.211995 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bc8410b2-32fb-4a9b-975a-37965b60653b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:33.212547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bc8410b2-32fb-4a9b-975a-37965b60653b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:33.219036 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc8410b2-32fb-4a9b-975a-37965b60653b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:33.219539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc8410b2-32fb-4a9b-975a-37965b60653b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:33.219971 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc8410b2-32fb-4a9b-975a-37965b60653b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:33.220667 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc8410b2-32fb-4a9b-975a-37965b60653b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:33.221116 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc8410b2-32fb-4a9b-975a-37965b60653b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:33.221566 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc8410b2-32fb-4a9b-975a-37965b60653b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:33.244025 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bc8410b2-32fb-4a9b-975a-37965b60653b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab/ips" status: 200 len: 150 microversion: 2.1 time: 0.045322 Sep 13 01:21:33.244586 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 212/423] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 01:21:33 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab/ips => generated 150 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:21:33.961645 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-2f60f6a4-d907-434b-a840-a1240538b1bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:33.962179 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-2f60f6a4-d907-434b-a840-a1240538b1bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:33.968524 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f60f6a4-d907-434b-a840-a1240538b1bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:33.969008 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f60f6a4-d907-434b-a840-a1240538b1bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:33.969432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f60f6a4-d907-434b-a840-a1240538b1bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:33.970111 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f60f6a4-d907-434b-a840-a1240538b1bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:33.970557 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f60f6a4-d907-434b-a840-a1240538b1bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:33.971010 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2f60f6a4-d907-434b-a840-a1240538b1bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:34.099417 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2f60f6a4-d907-434b-a840-a1240538b1bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:34.107784 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2f60f6a4-d907-434b-a840-a1240538b1bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:34.109209 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2f60f6a4-d907-434b-a840-a1240538b1bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:34.110355 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-2f60f6a4-d907-434b-a840-a1240538b1bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.152730 Sep 13 01:21:34.111026 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 212/424] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:33 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:34.612714 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b20b9a05-fde4-48b5-bb7b-e32b613d5a04 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cbc46b1-fa3e-4217-afa8-f1250e3237a1"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:34.615330 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b20b9a05-fde4-48b5-bb7b-e32b613d5a04 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:34.622507 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b20b9a05-fde4-48b5-bb7b-e32b613d5a04 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:34.623022 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b20b9a05-fde4-48b5-bb7b-e32b613d5a04 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:34.623465 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b20b9a05-fde4-48b5-bb7b-e32b613d5a04 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:34.624160 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b20b9a05-fde4-48b5-bb7b-e32b613d5a04 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:34.624619 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b20b9a05-fde4-48b5-bb7b-e32b613d5a04 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:34.625058 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b20b9a05-fde4-48b5-bb7b-e32b613d5a04 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:34.766573 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:34.884314 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b20b9a05-fde4-48b5-bb7b-e32b613d5a04 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "POST /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.275405 Sep 13 01:21:34.884922 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 213/425] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:21:34 2022] POST /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:21:35.136765 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3016e861-b6a5-48f2-b556-c0f89688a7ba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:35.137449 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3016e861-b6a5-48f2-b556-c0f89688a7ba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:35.143874 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3016e861-b6a5-48f2-b556-c0f89688a7ba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:35.144358 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3016e861-b6a5-48f2-b556-c0f89688a7ba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:35.144796 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3016e861-b6a5-48f2-b556-c0f89688a7ba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:35.145517 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3016e861-b6a5-48f2-b556-c0f89688a7ba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:35.145973 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3016e861-b6a5-48f2-b556-c0f89688a7ba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:35.146398 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3016e861-b6a5-48f2-b556-c0f89688a7ba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:35.276901 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3016e861-b6a5-48f2-b556-c0f89688a7ba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:35.285344 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3016e861-b6a5-48f2-b556-c0f89688a7ba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:35.286794 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3016e861-b6a5-48f2-b556-c0f89688a7ba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:35.287974 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3016e861-b6a5-48f2-b556-c0f89688a7ba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.155271 Sep 13 01:21:35.288526 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 213/426] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:35 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:36.314055 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e2d4d9dd-c0ea-4090-a7ff-8e09f37dec68 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:36.314747 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e2d4d9dd-c0ea-4090-a7ff-8e09f37dec68 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:36.321354 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2d4d9dd-c0ea-4090-a7ff-8e09f37dec68 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:36.321837 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2d4d9dd-c0ea-4090-a7ff-8e09f37dec68 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:36.322270 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2d4d9dd-c0ea-4090-a7ff-8e09f37dec68 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:36.322996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2d4d9dd-c0ea-4090-a7ff-8e09f37dec68 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:36.323447 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2d4d9dd-c0ea-4090-a7ff-8e09f37dec68 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:36.323862 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2d4d9dd-c0ea-4090-a7ff-8e09f37dec68 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:36.451865 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e2d4d9dd-c0ea-4090-a7ff-8e09f37dec68 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:36.460306 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e2d4d9dd-c0ea-4090-a7ff-8e09f37dec68 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:36.461738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e2d4d9dd-c0ea-4090-a7ff-8e09f37dec68 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:36.462904 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e2d4d9dd-c0ea-4090-a7ff-8e09f37dec68 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.153633 Sep 13 01:21:36.463455 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 214/427] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:36 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:37.487712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-59d3be86-9e7a-47e8-9ee3-5bf0083b8051 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:37.488316 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-59d3be86-9e7a-47e8-9ee3-5bf0083b8051 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:37.494673 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-59d3be86-9e7a-47e8-9ee3-5bf0083b8051 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:37.495186 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-59d3be86-9e7a-47e8-9ee3-5bf0083b8051 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:37.495623 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-59d3be86-9e7a-47e8-9ee3-5bf0083b8051 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:37.496326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-59d3be86-9e7a-47e8-9ee3-5bf0083b8051 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:37.496773 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-59d3be86-9e7a-47e8-9ee3-5bf0083b8051 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:37.497191 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-59d3be86-9e7a-47e8-9ee3-5bf0083b8051 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:37.632132 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-59d3be86-9e7a-47e8-9ee3-5bf0083b8051 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:37.640628 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-59d3be86-9e7a-47e8-9ee3-5bf0083b8051 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:37.642717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-59d3be86-9e7a-47e8-9ee3-5bf0083b8051 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:37.643961 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-59d3be86-9e7a-47e8-9ee3-5bf0083b8051 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.160158 Sep 13 01:21:37.644531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 214/428] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:37 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:38.193211 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1ef4556a-cfcb-4e43-8228-68974977c2ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Action: 'create', calling method: .version_select at 0x7fb05e5a9c10>, body: {"keypair": {"name": "tempest-keypair-582127525", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA+JHqfk0zzWxdfCdy0mBeERzACdtNnu0edO875TSOyYabNWgeTUtJ/pVIxo53zkIiXz6p4gxn9fCPZuxfNfVg2JBeT2B+d6Pw+JMcG4KR5EQy6HeT5E4CJmOsB/DleQ7g=="}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:38.209125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-1ef4556a-cfcb-4e43-8228-68974977c2ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for project 30ce8239a9b34af685743812ce53ef19. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:21:38.212909 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-1ef4556a-cfcb-4e43-8228-68974977c2ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for user 776733af5b6a4115b2a11d67666a379d and project 30ce8239a9b34af685743812ce53ef19. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:21:38.234229 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1ef4556a-cfcb-4e43-8228-68974977c2ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044716 Sep 13 01:21:38.234795 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 215/429] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 01:21:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:21:38.668718 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b63508ef-a028-4dd0-8a89-621dc649906d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:38.669531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b63508ef-a028-4dd0-8a89-621dc649906d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:38.675953 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b63508ef-a028-4dd0-8a89-621dc649906d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:38.676443 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b63508ef-a028-4dd0-8a89-621dc649906d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:38.676882 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b63508ef-a028-4dd0-8a89-621dc649906d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:38.677581 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b63508ef-a028-4dd0-8a89-621dc649906d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:38.678041 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b63508ef-a028-4dd0-8a89-621dc649906d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:38.678465 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b63508ef-a028-4dd0-8a89-621dc649906d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:38.811955 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b63508ef-a028-4dd0-8a89-621dc649906d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:38.820579 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b63508ef-a028-4dd0-8a89-621dc649906d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:38.822011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b63508ef-a028-4dd0-8a89-621dc649906d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:38.823204 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b63508ef-a028-4dd0-8a89-621dc649906d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.158645 Sep 13 01:21:38.823766 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 215/430] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:38 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:39.717999 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1262814797", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed8fe8c3-8c67-4c53-9bb3-c1aeeaaaf18e"}], "security_groups": [{"name": "tempest-securitygroup--1345873173"}], "key_name": "tempest-keypair-582127525", "user_data": "}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:39.819742 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] validate_networks() for [('ed8fe8c3-8c67-4c53-9bb3-c1aeeaaaf18e', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:21:39.847373 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-cee97273-cb6a-46b0-902b-d4e0081643b2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:39.848016 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-cee97273-cb6a-46b0-902b-d4e0081643b2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:39.854244 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cee97273-cb6a-46b0-902b-d4e0081643b2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:39.854733 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cee97273-cb6a-46b0-902b-d4e0081643b2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:39.855212 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cee97273-cb6a-46b0-902b-d4e0081643b2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:39.855963 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cee97273-cb6a-46b0-902b-d4e0081643b2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:39.856612 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cee97273-cb6a-46b0-902b-d4e0081643b2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:39.857196 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cee97273-cb6a-46b0-902b-d4e0081643b2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:39.985192 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-cee97273-cb6a-46b0-902b-d4e0081643b2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:39.993686 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-cee97273-cb6a-46b0-902b-d4e0081643b2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:39.995137 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-cee97273-cb6a-46b0-902b-d4e0081643b2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:39.996289 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-cee97273-cb6a-46b0-902b-d4e0081643b2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.152918 Sep 13 01:21:39.997366 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 216/431] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:39 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:21:40.187701 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:21:40.188128 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:21:40.188657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:21:40.189063 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:21:40.189589 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:21:40.198423 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:40.198935 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:40.199398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:40.200823 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:40.201275 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:40.201696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:40.218193 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for project 30ce8239a9b34af685743812ce53ef19. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:21:40.222130 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for user 776733af5b6a4115b2a11d67666a379d and project 30ce8239a9b34af685743812ce53ef19. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:21:40.233422 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:21:40.235651 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:21:40.280800 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1c38d5e9-9afc-4bc0-99be-adf086920a36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.568058 Sep 13 01:21:40.281436 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 216/432] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:21:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 01:21:40.292685 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3eb0737e-c03d-49ef-9a4d-2d3979c80d41 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:40.293895 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3eb0737e-c03d-49ef-9a4d-2d3979c80d41 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:40.345661 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3eb0737e-c03d-49ef-9a4d-2d3979c80d41 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:40.352528 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3eb0737e-c03d-49ef-9a4d-2d3979c80d41 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1241 microversion: 2.1 time: 0.063803 Sep 13 01:21:40.353103 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 217/433] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:40 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1241 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:41.010726 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-3ec691f3-9e7b-405e-abc5-9506dce1730a req-da8b707b-7b77-4a02-b8cf-b90fc0fc5cdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1677b90a-17f0-496f-8fce-ac573509c1ac", "name": "network-vif-plugged", "status": "completed", "tag": "88cd16db-1d4f-46f0-9069-3f6713e3efbd"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:41.021487 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-3ec691f3-9e7b-405e-abc5-9506dce1730a req-da8b707b-7b77-4a02-b8cf-b90fc0fc5cdb service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:41.021728 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-3ec691f3-9e7b-405e-abc5-9506dce1730a req-da8b707b-7b77-4a02-b8cf-b90fc0fc5cdb service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:41.022197 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-3ec691f3-9e7b-405e-abc5-9506dce1730a req-da8b707b-7b77-4a02-b8cf-b90fc0fc5cdb service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:41.023254 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-36e026b2-5031-49bf-9f61-052e09282cfa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:41.023976 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-36e026b2-5031-49bf-9f61-052e09282cfa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:41.032138 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-36e026b2-5031-49bf-9f61-052e09282cfa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:41.032960 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-36e026b2-5031-49bf-9f61-052e09282cfa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:41.033610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-36e026b2-5031-49bf-9f61-052e09282cfa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:41.034544 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-36e026b2-5031-49bf-9f61-052e09282cfa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:41.034874 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-3ec691f3-9e7b-405e-abc5-9506dce1730a req-da8b707b-7b77-4a02-b8cf-b90fc0fc5cdb service nova] Creating event network-vif-plugged:88cd16db-1d4f-46f0-9069-3f6713e3efbd for instance 1677b90a-17f0-496f-8fce-ac573509c1ac on hv-cinder-85694 Sep 13 01:21:41.035598 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-36e026b2-5031-49bf-9f61-052e09282cfa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:41.036351 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-36e026b2-5031-49bf-9f61-052e09282cfa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:41.040283 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-3ec691f3-9e7b-405e-abc5-9506dce1730a req-da8b707b-7b77-4a02-b8cf-b90fc0fc5cdb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033639 Sep 13 01:21:41.041846 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 217/434] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:21:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:21:41.056769 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:41.181925 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-36e026b2-5031-49bf-9f61-052e09282cfa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:41.190698 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-36e026b2-5031-49bf-9f61-052e09282cfa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:41.192178 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-36e026b2-5031-49bf-9f61-052e09282cfa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:41.193337 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-36e026b2-5031-49bf-9f61-052e09282cfa tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.175438 Sep 13 01:21:41.193896 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 218/435] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:41 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:21:41.377623 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4d40fcca-19d9-4876-ab59-1f2045a12ea8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:41.378241 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4d40fcca-19d9-4876-ab59-1f2045a12ea8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:41.384341 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d40fcca-19d9-4876-ab59-1f2045a12ea8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:41.384827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d40fcca-19d9-4876-ab59-1f2045a12ea8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:41.385260 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d40fcca-19d9-4876-ab59-1f2045a12ea8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:41.385949 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d40fcca-19d9-4876-ab59-1f2045a12ea8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:41.386410 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d40fcca-19d9-4876-ab59-1f2045a12ea8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:41.386832 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4d40fcca-19d9-4876-ab59-1f2045a12ea8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:41.447851 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4d40fcca-19d9-4876-ab59-1f2045a12ea8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:41.455931 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4d40fcca-19d9-4876-ab59-1f2045a12ea8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1293 microversion: 2.1 time: 0.082625 Sep 13 01:21:41.456495 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 218/436] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:41 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:42.218492 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4aeee072-817e-4242-ae69-d8968c08f46d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:42.219164 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4aeee072-817e-4242-ae69-d8968c08f46d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:42.225536 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4aeee072-817e-4242-ae69-d8968c08f46d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:42.226023 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4aeee072-817e-4242-ae69-d8968c08f46d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:42.226464 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4aeee072-817e-4242-ae69-d8968c08f46d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:42.227269 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4aeee072-817e-4242-ae69-d8968c08f46d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:42.227747 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4aeee072-817e-4242-ae69-d8968c08f46d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:42.228262 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4aeee072-817e-4242-ae69-d8968c08f46d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:42.474897 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4aeee072-817e-4242-ae69-d8968c08f46d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:42.477434 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c8374817-77fc-4e73-8deb-72fee2dea4e7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:42.478045 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c8374817-77fc-4e73-8deb-72fee2dea4e7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:42.484151 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4aeee072-817e-4242-ae69-d8968c08f46d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:42.484908 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8374817-77fc-4e73-8deb-72fee2dea4e7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:42.485403 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8374817-77fc-4e73-8deb-72fee2dea4e7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:42.485821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4aeee072-817e-4242-ae69-d8968c08f46d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:42.485930 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8374817-77fc-4e73-8deb-72fee2dea4e7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:42.486497 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8374817-77fc-4e73-8deb-72fee2dea4e7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:42.487073 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4aeee072-817e-4242-ae69-d8968c08f46d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.272989 Sep 13 01:21:42.487195 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8374817-77fc-4e73-8deb-72fee2dea4e7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:42.487564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8374817-77fc-4e73-8deb-72fee2dea4e7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:42.487654 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 219/437] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:42 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:21:42.546965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c8374817-77fc-4e73-8deb-72fee2dea4e7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:42.554658 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c8374817-77fc-4e73-8deb-72fee2dea4e7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1299 microversion: 2.1 time: 0.081051 Sep 13 01:21:42.555450 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 219/438] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:42 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1299 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:43.511592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-db273db5-905e-4841-80ed-93f37e00ba02 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:43.512718 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-db273db5-905e-4841-80ed-93f37e00ba02 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:43.522245 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-db273db5-905e-4841-80ed-93f37e00ba02 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:43.522934 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-db273db5-905e-4841-80ed-93f37e00ba02 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:43.523371 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-db273db5-905e-4841-80ed-93f37e00ba02 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:43.524103 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-db273db5-905e-4841-80ed-93f37e00ba02 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:43.524701 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-db273db5-905e-4841-80ed-93f37e00ba02 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:43.525246 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-db273db5-905e-4841-80ed-93f37e00ba02 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:43.578204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6ddb09ff-2ae8-47de-a6dd-74909f110a34 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:43.578820 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6ddb09ff-2ae8-47de-a6dd-74909f110a34 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:43.585201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6ddb09ff-2ae8-47de-a6dd-74909f110a34 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:43.585654 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6ddb09ff-2ae8-47de-a6dd-74909f110a34 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:43.586085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6ddb09ff-2ae8-47de-a6dd-74909f110a34 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:43.586770 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6ddb09ff-2ae8-47de-a6dd-74909f110a34 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:43.587243 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6ddb09ff-2ae8-47de-a6dd-74909f110a34 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:43.587658 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6ddb09ff-2ae8-47de-a6dd-74909f110a34 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:43.719902 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6ddb09ff-2ae8-47de-a6dd-74909f110a34 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:43.727456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6ddb09ff-2ae8-47de-a6dd-74909f110a34 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1367 microversion: 2.1 time: 0.153542 Sep 13 01:21:43.728632 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 220/439] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:43 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:43.733733 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-db273db5-905e-4841-80ed-93f37e00ba02 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:43.742320 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-db273db5-905e-4841-80ed-93f37e00ba02 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:43.743789 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-db273db5-905e-4841-80ed-93f37e00ba02 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:43.744965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-db273db5-905e-4841-80ed-93f37e00ba02 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1807 microversion: 2.20 time: 0.237217 Sep 13 01:21:43.745520 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 220/440] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:43 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:44.057228 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-962e7262-2e96-4d72-9bb2-071364be8dca req-e4b7b9ef-f62d-4016-bd8f-02745a16ec34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c255cb11-a9fd-46ce-8618-2177ad7f3f76", "tag": "55824feb-f6a5-4ec6-b3c3-0b46eea4735b"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:44.068598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-962e7262-2e96-4d72-9bb2-071364be8dca req-e4b7b9ef-f62d-4016-bd8f-02745a16ec34 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:44.069088 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-962e7262-2e96-4d72-9bb2-071364be8dca req-e4b7b9ef-f62d-4016-bd8f-02745a16ec34 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:44.069523 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-962e7262-2e96-4d72-9bb2-071364be8dca req-e4b7b9ef-f62d-4016-bd8f-02745a16ec34 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:44.081327 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-962e7262-2e96-4d72-9bb2-071364be8dca req-e4b7b9ef-f62d-4016-bd8f-02745a16ec34 service nova] Creating event network-changed:55824feb-f6a5-4ec6-b3c3-0b46eea4735b for instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 on hv-cinder-85694 Sep 13 01:21:44.088198 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-962e7262-2e96-4d72-9bb2-071364be8dca req-e4b7b9ef-f62d-4016-bd8f-02745a16ec34 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034917 Sep 13 01:21:44.089676 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 221/441] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:21:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:21:44.750646 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ea54225f-1048-4ee2-be28-b1fbef86a81f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:44.751301 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ea54225f-1048-4ee2-be28-b1fbef86a81f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:44.758048 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ea54225f-1048-4ee2-be28-b1fbef86a81f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:44.758536 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ea54225f-1048-4ee2-be28-b1fbef86a81f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:44.759073 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ea54225f-1048-4ee2-be28-b1fbef86a81f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:44.759771 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ea54225f-1048-4ee2-be28-b1fbef86a81f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:44.760225 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ea54225f-1048-4ee2-be28-b1fbef86a81f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:44.760648 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ea54225f-1048-4ee2-be28-b1fbef86a81f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:44.771908 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-325149c4-6959-410d-ab29-4b506297f8e8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:44.772901 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-325149c4-6959-410d-ab29-4b506297f8e8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:44.780593 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-325149c4-6959-410d-ab29-4b506297f8e8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:44.781418 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-325149c4-6959-410d-ab29-4b506297f8e8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:44.782088 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-325149c4-6959-410d-ab29-4b506297f8e8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:44.783173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-325149c4-6959-410d-ab29-4b506297f8e8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:44.783854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-325149c4-6959-410d-ab29-4b506297f8e8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:44.785149 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-325149c4-6959-410d-ab29-4b506297f8e8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:44.921412 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-325149c4-6959-410d-ab29-4b506297f8e8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:44.931417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-325149c4-6959-410d-ab29-4b506297f8e8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:44.932972 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-325149c4-6959-410d-ab29-4b506297f8e8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:44.934273 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-325149c4-6959-410d-ab29-4b506297f8e8 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1794 microversion: 2.20 time: 0.166736 Sep 13 01:21:44.935296 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 222/442] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:21:44 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1794 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:21:45.227130 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ea54225f-1048-4ee2-be28-b1fbef86a81f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:45.234616 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ea54225f-1048-4ee2-be28-b1fbef86a81f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1367 microversion: 2.1 time: 0.487995 Sep 13 01:21:45.235229 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 221/443] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:44 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1367 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:46.257433 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-af0ecb49-494c-4a3c-803f-21d48d960939 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:46.258075 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-af0ecb49-494c-4a3c-803f-21d48d960939 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:46.264342 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af0ecb49-494c-4a3c-803f-21d48d960939 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:46.264821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af0ecb49-494c-4a3c-803f-21d48d960939 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:46.265254 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af0ecb49-494c-4a3c-803f-21d48d960939 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:46.265936 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af0ecb49-494c-4a3c-803f-21d48d960939 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:46.266383 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af0ecb49-494c-4a3c-803f-21d48d960939 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:46.266802 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af0ecb49-494c-4a3c-803f-21d48d960939 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:46.394910 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-af0ecb49-494c-4a3c-803f-21d48d960939 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:46.402382 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-af0ecb49-494c-4a3c-803f-21d48d960939 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1367 microversion: 2.1 time: 0.148733 Sep 13 01:21:46.402961 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 223/444] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:46 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:47.424989 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9cc92b61-395f-41e2-aa28-b050a489ca78 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:47.425597 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9cc92b61-395f-41e2-aa28-b050a489ca78 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:47.431971 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9cc92b61-395f-41e2-aa28-b050a489ca78 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:47.432451 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9cc92b61-395f-41e2-aa28-b050a489ca78 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:47.432880 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9cc92b61-395f-41e2-aa28-b050a489ca78 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:47.433563 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9cc92b61-395f-41e2-aa28-b050a489ca78 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:47.434009 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9cc92b61-395f-41e2-aa28-b050a489ca78 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:47.434689 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9cc92b61-395f-41e2-aa28-b050a489ca78 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:47.563345 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-9cc92b61-395f-41e2-aa28-b050a489ca78 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:47.570962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9cc92b61-395f-41e2-aa28-b050a489ca78 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1367 microversion: 2.1 time: 0.149895 Sep 13 01:21:47.571537 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 222/445] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:47 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:48.594698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1a5f0076-bd10-441d-b24b-1b68380c41a8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:48.595358 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1a5f0076-bd10-441d-b24b-1b68380c41a8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:48.601718 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a5f0076-bd10-441d-b24b-1b68380c41a8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:48.602195 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a5f0076-bd10-441d-b24b-1b68380c41a8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:48.602627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a5f0076-bd10-441d-b24b-1b68380c41a8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:48.603354 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a5f0076-bd10-441d-b24b-1b68380c41a8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:48.603802 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a5f0076-bd10-441d-b24b-1b68380c41a8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:48.604219 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a5f0076-bd10-441d-b24b-1b68380c41a8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:48.728070 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1a5f0076-bd10-441d-b24b-1b68380c41a8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:48.735541 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1a5f0076-bd10-441d-b24b-1b68380c41a8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1367 microversion: 2.1 time: 0.145411 Sep 13 01:21:48.736261 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 224/446] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:48 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:49.759440 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-85fe735d-1e80-4d12-8c70-0217beac61fd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:49.760052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-85fe735d-1e80-4d12-8c70-0217beac61fd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:49.766380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-85fe735d-1e80-4d12-8c70-0217beac61fd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:49.766873 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-85fe735d-1e80-4d12-8c70-0217beac61fd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:49.767326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-85fe735d-1e80-4d12-8c70-0217beac61fd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:49.768017 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-85fe735d-1e80-4d12-8c70-0217beac61fd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:49.768466 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-85fe735d-1e80-4d12-8c70-0217beac61fd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:49.768886 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-85fe735d-1e80-4d12-8c70-0217beac61fd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:49.908650 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-85fe735d-1e80-4d12-8c70-0217beac61fd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:49.916170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-85fe735d-1e80-4d12-8c70-0217beac61fd tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1367 microversion: 2.1 time: 0.162099 Sep 13 01:21:49.916732 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 223/447] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:49 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:50.939542 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-18f84ec4-b78c-42e1-8400-6fc88941495f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:50.940151 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-18f84ec4-b78c-42e1-8400-6fc88941495f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:50.942528 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:50.943359 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=10 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:50.949362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18f84ec4-b78c-42e1-8400-6fc88941495f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:50.949846 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18f84ec4-b78c-42e1-8400-6fc88941495f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:50.950280 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18f84ec4-b78c-42e1-8400-6fc88941495f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:50.951007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18f84ec4-b78c-42e1-8400-6fc88941495f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:50.951962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18f84ec4-b78c-42e1-8400-6fc88941495f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:50.952377 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18f84ec4-b78c-42e1-8400-6fc88941495f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:50.966364 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-36403df2-6225-4c2f-ae6c-110f30f072b1 req-ed80d3b1-235b-4c36-9592-86b170a91bae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c255cb11-a9fd-46ce-8618-2177ad7f3f76", "name": "network-vif-plugged", "status": "completed", "tag": "55824feb-f6a5-4ec6-b3c3-0b46eea4735b"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:50.974750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:21:50.979546 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-36403df2-6225-4c2f-ae6c-110f30f072b1 req-ed80d3b1-235b-4c36-9592-86b170a91bae service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:50.980029 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-36403df2-6225-4c2f-ae6c-110f30f072b1 req-ed80d3b1-235b-4c36-9592-86b170a91bae service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:50.980461 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-36403df2-6225-4c2f-ae6c-110f30f072b1 req-ed80d3b1-235b-4c36-9592-86b170a91bae service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:50.991933 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-36403df2-6225-4c2f-ae6c-110f30f072b1 req-ed80d3b1-235b-4c36-9592-86b170a91bae service nova] Creating event network-vif-plugged:55824feb-f6a5-4ec6-b3c3-0b46eea4735b for instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 on hv-cinder-85694 Sep 13 01:21:50.997243 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-36403df2-6225-4c2f-ae6c-110f30f072b1 req-ed80d3b1-235b-4c36-9592-86b170a91bae service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034593 Sep 13 01:21:50.997842 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 224/448] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:21:51.088683 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-18f84ec4-b78c-42e1-8400-6fc88941495f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:51.098134 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-18f84ec4-b78c-42e1-8400-6fc88941495f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1367 microversion: 2.1 time: 0.162186 Sep 13 01:21:51.098779 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 225/449] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:50 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:52.122124 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9a365299-2618-4a40-aeed-651b9124b103 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:52.123372 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9a365299-2618-4a40-aeed-651b9124b103 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:52.129484 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9a365299-2618-4a40-aeed-651b9124b103 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:52.129966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9a365299-2618-4a40-aeed-651b9124b103 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:52.130404 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9a365299-2618-4a40-aeed-651b9124b103 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:52.131123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9a365299-2618-4a40-aeed-651b9124b103 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:52.131574 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9a365299-2618-4a40-aeed-651b9124b103 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:52.131996 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9a365299-2618-4a40-aeed-651b9124b103 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:52.260860 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-9a365299-2618-4a40-aeed-651b9124b103 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:52.268397 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9a365299-2618-4a40-aeed-651b9124b103 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1367 microversion: 2.1 time: 0.151009 Sep 13 01:21:52.268966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 225/450] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:52 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:53.290943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-79fcbca9-8d49-4751-b715-84e6c7eb7f37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:53.291552 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-79fcbca9-8d49-4751-b715-84e6c7eb7f37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:53.298361 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79fcbca9-8d49-4751-b715-84e6c7eb7f37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:53.298841 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79fcbca9-8d49-4751-b715-84e6c7eb7f37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:53.299299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79fcbca9-8d49-4751-b715-84e6c7eb7f37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:53.299982 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79fcbca9-8d49-4751-b715-84e6c7eb7f37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:53.300430 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79fcbca9-8d49-4751-b715-84e6c7eb7f37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:53.300849 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-79fcbca9-8d49-4751-b715-84e6c7eb7f37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:53.430151 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-79fcbca9-8d49-4751-b715-84e6c7eb7f37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:53.437944 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-79fcbca9-8d49-4751-b715-84e6c7eb7f37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1367 microversion: 2.1 time: 0.150911 Sep 13 01:21:53.438498 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 226/451] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:53 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:54.460531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-28857dcf-b5fa-4952-8877-ba15f967a712 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:54.461148 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-28857dcf-b5fa-4952-8877-ba15f967a712 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:54.467497 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-28857dcf-b5fa-4952-8877-ba15f967a712 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:54.467984 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-28857dcf-b5fa-4952-8877-ba15f967a712 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:54.468422 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-28857dcf-b5fa-4952-8877-ba15f967a712 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:54.469112 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-28857dcf-b5fa-4952-8877-ba15f967a712 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:54.469567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-28857dcf-b5fa-4952-8877-ba15f967a712 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:54.469995 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-28857dcf-b5fa-4952-8877-ba15f967a712 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:54.597711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-28857dcf-b5fa-4952-8877-ba15f967a712 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:21:54.605242 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-28857dcf-b5fa-4952-8877-ba15f967a712 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1557 microversion: 2.1 time: 0.148687 Sep 13 01:21:54.605816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 226/452] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:21:54 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:21:54.628208 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d80abde9-5edf-417f-8b7d-4222deb9cd4a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:21:54.628778 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d80abde9-5edf-417f-8b7d-4222deb9cd4a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:21:54.635079 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d80abde9-5edf-417f-8b7d-4222deb9cd4a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:54.635567 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d80abde9-5edf-417f-8b7d-4222deb9cd4a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:54.636008 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d80abde9-5edf-417f-8b7d-4222deb9cd4a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:54.636713 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d80abde9-5edf-417f-8b7d-4222deb9cd4a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:54.637174 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d80abde9-5edf-417f-8b7d-4222deb9cd4a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:54.637602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d80abde9-5edf-417f-8b7d-4222deb9cd4a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:54.711730 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d80abde9-5edf-417f-8b7d-4222deb9cd4a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087331 Sep 13 01:21:54.712315 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 227/453] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 01:21:54 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:21:55.621178 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-53ddc87d-8368-4d72-8feb-78a21ed8385d req-eb1b8ea5-235c-4d4b-a997-6a55082584f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c255cb11-a9fd-46ce-8618-2177ad7f3f76", "tag": "55824feb-f6a5-4ec6-b3c3-0b46eea4735b"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:21:55.631390 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-53ddc87d-8368-4d72-8feb-78a21ed8385d req-eb1b8ea5-235c-4d4b-a997-6a55082584f5 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:21:55.631870 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-53ddc87d-8368-4d72-8feb-78a21ed8385d req-eb1b8ea5-235c-4d4b-a997-6a55082584f5 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:21:55.632301 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-53ddc87d-8368-4d72-8feb-78a21ed8385d req-eb1b8ea5-235c-4d4b-a997-6a55082584f5 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:21:55.643468 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-53ddc87d-8368-4d72-8feb-78a21ed8385d req-eb1b8ea5-235c-4d4b-a997-6a55082584f5 service nova] Creating event network-changed:55824feb-f6a5-4ec6-b3c3-0b46eea4735b for instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 on hv-cinder-85694 Sep 13 01:21:55.648390 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-53ddc87d-8368-4d72-8feb-78a21ed8385d req-eb1b8ea5-235c-4d4b-a997-6a55082584f5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030861 Sep 13 01:21:55.649301 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 227/454] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:21:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:22:01.725004 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8eb8bb95-eeba-415e-9f0c-148f3ca3b3ef tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b3b62c9f-35ac-458d-b4bd-495ceca4ca00"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:01.727399 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8eb8bb95-eeba-415e-9f0c-148f3ca3b3ef tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:01.729342 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:01.735313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8eb8bb95-eeba-415e-9f0c-148f3ca3b3ef tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:01.735840 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8eb8bb95-eeba-415e-9f0c-148f3ca3b3ef tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:01.736277 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8eb8bb95-eeba-415e-9f0c-148f3ca3b3ef tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:01.736989 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8eb8bb95-eeba-415e-9f0c-148f3ca3b3ef tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:01.737440 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8eb8bb95-eeba-415e-9f0c-148f3ca3b3ef tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:01.737863 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8eb8bb95-eeba-415e-9f0c-148f3ca3b3ef tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:01.974224 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8eb8bb95-eeba-415e-9f0c-148f3ca3b3ef tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "POST /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253975 Sep 13 01:22:01.974924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 228/455] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:22:01 2022] POST /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:22:05.005034 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-050577e5-b940-4b80-9da2-d1aca9598dfd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:05.005624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-050577e5-b940-4b80-9da2-d1aca9598dfd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:05.007522 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=38 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:05.012951 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-050577e5-b940-4b80-9da2-d1aca9598dfd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:05.013433 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-050577e5-b940-4b80-9da2-d1aca9598dfd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:05.013868 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-050577e5-b940-4b80-9da2-d1aca9598dfd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:05.014556 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-050577e5-b940-4b80-9da2-d1aca9598dfd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:05.015041 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-050577e5-b940-4b80-9da2-d1aca9598dfd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:05.015468 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-050577e5-b940-4b80-9da2-d1aca9598dfd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:05.137917 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-050577e5-b940-4b80-9da2-d1aca9598dfd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lazy-loading 'services' on Instance uuid 85de1ecb-9d12-49d4-b0cd-4631e36357d3 {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:22:05.261388 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-050577e5-b940-4b80-9da2-d1aca9598dfd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "DELETE /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/os-volume_attachments/44f3fcea-07c1-4a07-bd3c-4c4a6be49a3e" status: 202 len: 0 microversion: 2.1 time: 0.260632 Sep 13 01:22:05.261988 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 228/456] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 01:22:04 2022] DELETE /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/os-volume_attachments/44f3fcea-07c1-4a07-bd3c-4c4a6be49a3e => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:22:09.519725 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-66a5e5d9-3990-45b2-bc45-e8e3bd9d92da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:09.522079 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-66a5e5d9-3990-45b2-bc45-e8e3bd9d92da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:09.528359 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-66a5e5d9-3990-45b2-bc45-e8e3bd9d92da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:09.529402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-66a5e5d9-3990-45b2-bc45-e8e3bd9d92da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:09.529864 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-66a5e5d9-3990-45b2-bc45-e8e3bd9d92da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:09.530458 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-66a5e5d9-3990-45b2-bc45-e8e3bd9d92da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:09.530929 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-66a5e5d9-3990-45b2-bc45-e8e3bd9d92da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:09.531352 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-66a5e5d9-3990-45b2-bc45-e8e3bd9d92da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:09.533856 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:09.558183 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-66a5e5d9-3990-45b2-bc45-e8e3bd9d92da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lazy-loading 'flavor' on Instance uuid d89f56d9-6326-419a-ad10-fb520d83ec2a {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:22:09.680599 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-66a5e5d9-3990-45b2-bc45-e8e3bd9d92da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "POST /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/action" status: 200 len: 32 microversion: 2.1 time: 0.165590 Sep 13 01:22:09.681192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 229/457] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:22:09 2022] POST /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 01:22:09.691744 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e0c1d59f-423b-4c09-a677-4370afd095da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:09.692445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-e0c1d59f-423b-4c09-a677-4370afd095da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:09.699192 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0c1d59f-423b-4c09-a677-4370afd095da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:09.699680 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0c1d59f-423b-4c09-a677-4370afd095da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:09.700668 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0c1d59f-423b-4c09-a677-4370afd095da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:09.701394 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0c1d59f-423b-4c09-a677-4370afd095da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:09.702128 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0c1d59f-423b-4c09-a677-4370afd095da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:09.702560 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0c1d59f-423b-4c09-a677-4370afd095da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:09.909936 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-e0c1d59f-423b-4c09-a677-4370afd095da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:09.918391 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-e0c1d59f-423b-4c09-a677-4370afd095da tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1734 microversion: 2.1 time: 0.230806 Sep 13 01:22:09.919326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 229/458] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:09 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:10.620530 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-343dccc0-105d-4a40-aea7-1a1d478972f0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:10.626621 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-343dccc0-105d-4a40-aea7-1a1d478972f0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:10.627139 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-343dccc0-105d-4a40-aea7-1a1d478972f0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:10.627580 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-343dccc0-105d-4a40-aea7-1a1d478972f0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:10.687150 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-343dccc0-105d-4a40-aea7-1a1d478972f0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Going to try to stop instance {{(pid=120415) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 13 01:22:10.729465 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-343dccc0-105d-4a40-aea7-1a1d478972f0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "POST /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/action" status: 202 len: 0 microversion: 2.1 time: 0.113457 Sep 13 01:22:10.730125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 230/459] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:22:10 2022] POST /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:22:10.738218 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5b78c5e6-14aa-4a50-938d-ac85e0fbd539 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:10.738834 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-5b78c5e6-14aa-4a50-938d-ac85e0fbd539 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:10.745370 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5b78c5e6-14aa-4a50-938d-ac85e0fbd539 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:10.745864 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5b78c5e6-14aa-4a50-938d-ac85e0fbd539 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:10.746340 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5b78c5e6-14aa-4a50-938d-ac85e0fbd539 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:10.747607 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5b78c5e6-14aa-4a50-938d-ac85e0fbd539 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:10.748065 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5b78c5e6-14aa-4a50-938d-ac85e0fbd539 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:10.748493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5b78c5e6-14aa-4a50-938d-ac85e0fbd539 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:10.878809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5b78c5e6-14aa-4a50-938d-ac85e0fbd539 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:10.886399 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-5b78c5e6-14aa-4a50-938d-ac85e0fbd539 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.151981 Sep 13 01:22:10.886986 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 230/460] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:10 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:22:10.942114 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e10f67c3-a675-4352-b2e3-6c532398879f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:10.942812 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e10f67c3-a675-4352-b2e3-6c532398879f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:10.948943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e10f67c3-a675-4352-b2e3-6c532398879f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:10.949430 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e10f67c3-a675-4352-b2e3-6c532398879f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:10.949869 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e10f67c3-a675-4352-b2e3-6c532398879f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:10.951143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e10f67c3-a675-4352-b2e3-6c532398879f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:10.951600 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e10f67c3-a675-4352-b2e3-6c532398879f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:10.952024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e10f67c3-a675-4352-b2e3-6c532398879f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:11.079990 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e10f67c3-a675-4352-b2e3-6c532398879f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:11.088038 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e10f67c3-a675-4352-b2e3-6c532398879f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1734 microversion: 2.1 time: 0.150066 Sep 13 01:22:11.088604 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 231/461] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:10 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:11.910360 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5edbc2a5-d736-46b9-969c-2b38640ab6e4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:11.910995 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-5edbc2a5-d736-46b9-969c-2b38640ab6e4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:11.917337 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5edbc2a5-d736-46b9-969c-2b38640ab6e4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:11.917823 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5edbc2a5-d736-46b9-969c-2b38640ab6e4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:11.918256 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5edbc2a5-d736-46b9-969c-2b38640ab6e4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:11.918965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5edbc2a5-d736-46b9-969c-2b38640ab6e4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:11.919418 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5edbc2a5-d736-46b9-969c-2b38640ab6e4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:11.919841 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5edbc2a5-d736-46b9-969c-2b38640ab6e4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:11.922420 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=70,nova_cell1:INSERT=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:12.049112 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5edbc2a5-d736-46b9-969c-2b38640ab6e4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:12.056664 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-5edbc2a5-d736-46b9-969c-2b38640ab6e4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.150157 Sep 13 01:22:12.057220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 231/462] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:11 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:12.111724 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d1e41d41-0aa2-4767-a6bf-bae8bf772a83 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:12.112330 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d1e41d41-0aa2-4767-a6bf-bae8bf772a83 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:12.118820 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1e41d41-0aa2-4767-a6bf-bae8bf772a83 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:12.119343 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1e41d41-0aa2-4767-a6bf-bae8bf772a83 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:12.119780 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1e41d41-0aa2-4767-a6bf-bae8bf772a83 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:12.120476 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1e41d41-0aa2-4767-a6bf-bae8bf772a83 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:12.120928 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1e41d41-0aa2-4767-a6bf-bae8bf772a83 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:12.121352 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d1e41d41-0aa2-4767-a6bf-bae8bf772a83 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:12.248129 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d1e41d41-0aa2-4767-a6bf-bae8bf772a83 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:12.256254 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d1e41d41-0aa2-4767-a6bf-bae8bf772a83 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1734 microversion: 2.1 time: 0.148320 Sep 13 01:22:12.256757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 232/463] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:12 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:13.079953 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-85d6d3e7-063b-4866-814f-7409bee7467b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:13.080594 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-85d6d3e7-063b-4866-814f-7409bee7467b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:13.087448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-85d6d3e7-063b-4866-814f-7409bee7467b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:13.087930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-85d6d3e7-063b-4866-814f-7409bee7467b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:13.088363 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-85d6d3e7-063b-4866-814f-7409bee7467b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:13.089047 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-85d6d3e7-063b-4866-814f-7409bee7467b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:13.089498 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-85d6d3e7-063b-4866-814f-7409bee7467b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:13.089915 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-85d6d3e7-063b-4866-814f-7409bee7467b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:13.213714 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-85d6d3e7-063b-4866-814f-7409bee7467b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:13.221804 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-85d6d3e7-063b-4866-814f-7409bee7467b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.145694 Sep 13 01:22:13.222374 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 232/464] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:13 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:13.279573 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d9a47cb7-36ec-444e-b1aa-196b0b6dada8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:13.280173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d9a47cb7-36ec-444e-b1aa-196b0b6dada8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:13.286730 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9a47cb7-36ec-444e-b1aa-196b0b6dada8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:13.287253 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9a47cb7-36ec-444e-b1aa-196b0b6dada8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:13.287688 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9a47cb7-36ec-444e-b1aa-196b0b6dada8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:13.288380 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9a47cb7-36ec-444e-b1aa-196b0b6dada8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:13.288829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9a47cb7-36ec-444e-b1aa-196b0b6dada8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:13.289249 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9a47cb7-36ec-444e-b1aa-196b0b6dada8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:13.413674 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d9a47cb7-36ec-444e-b1aa-196b0b6dada8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:13.422687 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d9a47cb7-36ec-444e-b1aa-196b0b6dada8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1734 microversion: 2.1 time: 0.146913 Sep 13 01:22:13.423271 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 233/465] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:13 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:14.244805 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-898ed9d0-1190-484f-a8bf-ad404a7190de tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:14.245416 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-898ed9d0-1190-484f-a8bf-ad404a7190de tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:14.251782 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-898ed9d0-1190-484f-a8bf-ad404a7190de tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:14.252270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-898ed9d0-1190-484f-a8bf-ad404a7190de tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:14.252707 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-898ed9d0-1190-484f-a8bf-ad404a7190de tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:14.253394 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-898ed9d0-1190-484f-a8bf-ad404a7190de tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:14.253853 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-898ed9d0-1190-484f-a8bf-ad404a7190de tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:14.254272 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-898ed9d0-1190-484f-a8bf-ad404a7190de tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:14.380086 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-898ed9d0-1190-484f-a8bf-ad404a7190de tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:14.388427 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-898ed9d0-1190-484f-a8bf-ad404a7190de tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.147461 Sep 13 01:22:14.388995 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 233/466] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:14 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:14.447822 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-adabf668-0c21-446b-b36e-e34cafffdc27 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:14.448429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-adabf668-0c21-446b-b36e-e34cafffdc27 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:14.457198 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-adabf668-0c21-446b-b36e-e34cafffdc27 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:14.457705 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-adabf668-0c21-446b-b36e-e34cafffdc27 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:14.458137 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-adabf668-0c21-446b-b36e-e34cafffdc27 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:14.458826 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-adabf668-0c21-446b-b36e-e34cafffdc27 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:14.459300 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-adabf668-0c21-446b-b36e-e34cafffdc27 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:14.459721 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-adabf668-0c21-446b-b36e-e34cafffdc27 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:14.585691 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-adabf668-0c21-446b-b36e-e34cafffdc27 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:14.593738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-adabf668-0c21-446b-b36e-e34cafffdc27 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1734 microversion: 2.1 time: 0.149743 Sep 13 01:22:14.594292 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 234/467] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:14 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:15.411101 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b8332a4b-4e33-450f-8283-32b929df0b1a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:15.411708 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b8332a4b-4e33-450f-8283-32b929df0b1a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:15.418047 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b8332a4b-4e33-450f-8283-32b929df0b1a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:15.419048 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b8332a4b-4e33-450f-8283-32b929df0b1a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:15.419491 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b8332a4b-4e33-450f-8283-32b929df0b1a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:15.420175 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b8332a4b-4e33-450f-8283-32b929df0b1a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:15.420621 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b8332a4b-4e33-450f-8283-32b929df0b1a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:15.421038 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b8332a4b-4e33-450f-8283-32b929df0b1a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:15.546003 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b8332a4b-4e33-450f-8283-32b929df0b1a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:15.553620 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b8332a4b-4e33-450f-8283-32b929df0b1a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.146397 Sep 13 01:22:15.554184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 234/468] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:15 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:15.616680 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-34de6a19-412a-4af2-9369-7d6a796e9511 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:15.617297 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-34de6a19-412a-4af2-9369-7d6a796e9511 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:15.624534 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-34de6a19-412a-4af2-9369-7d6a796e9511 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:15.625020 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-34de6a19-412a-4af2-9369-7d6a796e9511 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:15.625462 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-34de6a19-412a-4af2-9369-7d6a796e9511 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:15.626154 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-34de6a19-412a-4af2-9369-7d6a796e9511 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:15.626609 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-34de6a19-412a-4af2-9369-7d6a796e9511 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:15.627063 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-34de6a19-412a-4af2-9369-7d6a796e9511 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:15.755533 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-34de6a19-412a-4af2-9369-7d6a796e9511 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:15.763927 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-34de6a19-412a-4af2-9369-7d6a796e9511 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1734 microversion: 2.1 time: 0.151135 Sep 13 01:22:15.764526 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 235/469] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:15 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:16.577080 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-82636cd1-5458-4860-bc37-062d757c9404 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:16.577723 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-82636cd1-5458-4860-bc37-062d757c9404 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:16.584162 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-82636cd1-5458-4860-bc37-062d757c9404 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:16.584648 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-82636cd1-5458-4860-bc37-062d757c9404 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:16.585083 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-82636cd1-5458-4860-bc37-062d757c9404 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:16.585769 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-82636cd1-5458-4860-bc37-062d757c9404 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:16.586219 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-82636cd1-5458-4860-bc37-062d757c9404 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:16.586644 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-82636cd1-5458-4860-bc37-062d757c9404 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:16.720013 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-82636cd1-5458-4860-bc37-062d757c9404 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:16.727619 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-82636cd1-5458-4860-bc37-062d757c9404 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.155077 Sep 13 01:22:16.728188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 235/470] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:16 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:16.786784 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5ed34159-f3c3-4e99-92f0-2b3cdd270320 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:16.787416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5ed34159-f3c3-4e99-92f0-2b3cdd270320 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:16.793767 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ed34159-f3c3-4e99-92f0-2b3cdd270320 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:16.794272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ed34159-f3c3-4e99-92f0-2b3cdd270320 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:16.794708 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ed34159-f3c3-4e99-92f0-2b3cdd270320 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:16.795429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ed34159-f3c3-4e99-92f0-2b3cdd270320 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:16.795881 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ed34159-f3c3-4e99-92f0-2b3cdd270320 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:16.796302 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5ed34159-f3c3-4e99-92f0-2b3cdd270320 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:16.922120 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5ed34159-f3c3-4e99-92f0-2b3cdd270320 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:16.930260 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5ed34159-f3c3-4e99-92f0-2b3cdd270320 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1734 microversion: 2.1 time: 0.147269 Sep 13 01:22:16.930831 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 236/471] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:16 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:17.750479 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9407ed7e-185d-4983-9613-79a0799787aa tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:17.751149 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9407ed7e-185d-4983-9613-79a0799787aa tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:17.757497 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9407ed7e-185d-4983-9613-79a0799787aa tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:17.757978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9407ed7e-185d-4983-9613-79a0799787aa tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:17.758414 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9407ed7e-185d-4983-9613-79a0799787aa tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:17.759120 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9407ed7e-185d-4983-9613-79a0799787aa tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:17.759575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9407ed7e-185d-4983-9613-79a0799787aa tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:17.759998 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9407ed7e-185d-4983-9613-79a0799787aa tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:17.888824 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-9407ed7e-185d-4983-9613-79a0799787aa tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:17.896467 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9407ed7e-185d-4983-9613-79a0799787aa tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.149805 Sep 13 01:22:17.897034 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 236/472] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:17 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:17.954362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a25b6622-d69f-4d47-a1e9-c23d02a9816c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:17.955007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a25b6622-d69f-4d47-a1e9-c23d02a9816c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:17.963381 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a25b6622-d69f-4d47-a1e9-c23d02a9816c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:17.964079 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a25b6622-d69f-4d47-a1e9-c23d02a9816c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:17.964520 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a25b6622-d69f-4d47-a1e9-c23d02a9816c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:17.966024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a25b6622-d69f-4d47-a1e9-c23d02a9816c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:17.966604 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a25b6622-d69f-4d47-a1e9-c23d02a9816c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:17.967062 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a25b6622-d69f-4d47-a1e9-c23d02a9816c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:18.099581 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a25b6622-d69f-4d47-a1e9-c23d02a9816c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:18.107591 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a25b6622-d69f-4d47-a1e9-c23d02a9816c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1734 microversion: 2.1 time: 0.157657 Sep 13 01:22:18.108157 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 237/473] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:17 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:18.919713 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9c46e106-256f-4681-b0c3-e10f8da4e608 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:18.920331 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9c46e106-256f-4681-b0c3-e10f8da4e608 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:18.926640 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9c46e106-256f-4681-b0c3-e10f8da4e608 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:18.927168 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9c46e106-256f-4681-b0c3-e10f8da4e608 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:18.927603 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9c46e106-256f-4681-b0c3-e10f8da4e608 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:18.928299 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9c46e106-256f-4681-b0c3-e10f8da4e608 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:18.928747 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9c46e106-256f-4681-b0c3-e10f8da4e608 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:18.929170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9c46e106-256f-4681-b0c3-e10f8da4e608 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:19.053521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-9c46e106-256f-4681-b0c3-e10f8da4e608 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:19.061274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9c46e106-256f-4681-b0c3-e10f8da4e608 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.145403 Sep 13 01:22:19.061832 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 237/474] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:18 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:19.132031 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1c893370-b4bd-48a0-9e51-37bc52158bf0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:19.132666 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1c893370-b4bd-48a0-9e51-37bc52158bf0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:19.139053 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c893370-b4bd-48a0-9e51-37bc52158bf0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:19.139539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c893370-b4bd-48a0-9e51-37bc52158bf0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:19.139977 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c893370-b4bd-48a0-9e51-37bc52158bf0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:19.140669 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c893370-b4bd-48a0-9e51-37bc52158bf0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:19.141123 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c893370-b4bd-48a0-9e51-37bc52158bf0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:19.141545 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c893370-b4bd-48a0-9e51-37bc52158bf0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:19.267554 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1c893370-b4bd-48a0-9e51-37bc52158bf0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:19.280172 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1c893370-b4bd-48a0-9e51-37bc52158bf0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1734 microversion: 2.1 time: 0.151853 Sep 13 01:22:19.280742 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 238/475] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:19 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:20.084036 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e810d456-6a08-4380-bfd6-af81e91a3e7c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:20.084549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-e810d456-6a08-4380-bfd6-af81e91a3e7c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:20.090891 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e810d456-6a08-4380-bfd6-af81e91a3e7c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:20.091374 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e810d456-6a08-4380-bfd6-af81e91a3e7c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:20.091809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e810d456-6a08-4380-bfd6-af81e91a3e7c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:20.092490 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e810d456-6a08-4380-bfd6-af81e91a3e7c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:20.092939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e810d456-6a08-4380-bfd6-af81e91a3e7c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:20.093354 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e810d456-6a08-4380-bfd6-af81e91a3e7c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:20.219473 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-e810d456-6a08-4380-bfd6-af81e91a3e7c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:20.227286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-e810d456-6a08-4380-bfd6-af81e91a3e7c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.147081 Sep 13 01:22:20.227863 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 238/476] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:20 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:20.303865 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cfeb9f7f-ef4e-4dbb-97c8-9e26b1f54f3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:20.304475 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cfeb9f7f-ef4e-4dbb-97c8-9e26b1f54f3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:20.311874 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfeb9f7f-ef4e-4dbb-97c8-9e26b1f54f3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:20.312359 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfeb9f7f-ef4e-4dbb-97c8-9e26b1f54f3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:20.312795 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfeb9f7f-ef4e-4dbb-97c8-9e26b1f54f3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:20.313492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfeb9f7f-ef4e-4dbb-97c8-9e26b1f54f3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:20.313946 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfeb9f7f-ef4e-4dbb-97c8-9e26b1f54f3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:20.314370 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cfeb9f7f-ef4e-4dbb-97c8-9e26b1f54f3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:20.444992 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cfeb9f7f-ef4e-4dbb-97c8-9e26b1f54f3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:20.453156 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cfeb9f7f-ef4e-4dbb-97c8-9e26b1f54f3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1734 microversion: 2.1 time: 0.153176 Sep 13 01:22:20.453715 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 239/477] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:20 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:21.253746 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1b2ab0a1-3580-4c18-b041-18d1149360dd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:21.254428 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1b2ab0a1-3580-4c18-b041-18d1149360dd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:21.260748 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1b2ab0a1-3580-4c18-b041-18d1149360dd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:21.261230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1b2ab0a1-3580-4c18-b041-18d1149360dd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:21.261665 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1b2ab0a1-3580-4c18-b041-18d1149360dd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:21.263064 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1b2ab0a1-3580-4c18-b041-18d1149360dd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:21.263522 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1b2ab0a1-3580-4c18-b041-18d1149360dd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:21.263947 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1b2ab0a1-3580-4c18-b041-18d1149360dd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:21.391141 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1b2ab0a1-3580-4c18-b041-18d1149360dd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:21.398974 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1b2ab0a1-3580-4c18-b041-18d1149360dd tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.149028 Sep 13 01:22:21.399551 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 239/478] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:21 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:21.476539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d0b8760a-17b3-458f-87cc-d8d1965e1417 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:21.477140 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d0b8760a-17b3-458f-87cc-d8d1965e1417 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:21.484015 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0b8760a-17b3-458f-87cc-d8d1965e1417 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:21.484495 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0b8760a-17b3-458f-87cc-d8d1965e1417 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:21.484928 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0b8760a-17b3-458f-87cc-d8d1965e1417 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:21.485610 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0b8760a-17b3-458f-87cc-d8d1965e1417 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:21.486059 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0b8760a-17b3-458f-87cc-d8d1965e1417 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:21.486501 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0b8760a-17b3-458f-87cc-d8d1965e1417 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:21.614255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d0b8760a-17b3-458f-87cc-d8d1965e1417 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:21.622318 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d0b8760a-17b3-458f-87cc-d8d1965e1417 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1734 microversion: 2.1 time: 0.149682 Sep 13 01:22:21.623428 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 240/479] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:21 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:22.422005 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4e9f6208-8748-4fdb-b030-6e0c656fc795 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:22.422611 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4e9f6208-8748-4fdb-b030-6e0c656fc795 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:22.428984 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4e9f6208-8748-4fdb-b030-6e0c656fc795 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:22.429464 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4e9f6208-8748-4fdb-b030-6e0c656fc795 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:22.429892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4e9f6208-8748-4fdb-b030-6e0c656fc795 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:22.430576 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4e9f6208-8748-4fdb-b030-6e0c656fc795 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:22.431123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4e9f6208-8748-4fdb-b030-6e0c656fc795 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:22.431541 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4e9f6208-8748-4fdb-b030-6e0c656fc795 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:22.556394 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4e9f6208-8748-4fdb-b030-6e0c656fc795 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:22.566155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4e9f6208-8748-4fdb-b030-6e0c656fc795 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.148483 Sep 13 01:22:22.566738 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 240/480] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:22 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:22.645074 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ba144a99-7b44-49e6-afd7-f097745d2186 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:22.645683 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ba144a99-7b44-49e6-afd7-f097745d2186 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:22.652212 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ba144a99-7b44-49e6-afd7-f097745d2186 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:22.653237 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ba144a99-7b44-49e6-afd7-f097745d2186 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:22.653679 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ba144a99-7b44-49e6-afd7-f097745d2186 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:22.654370 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ba144a99-7b44-49e6-afd7-f097745d2186 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:22.654824 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ba144a99-7b44-49e6-afd7-f097745d2186 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:22.655272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ba144a99-7b44-49e6-afd7-f097745d2186 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:22.783344 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ba144a99-7b44-49e6-afd7-f097745d2186 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:22.791430 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ba144a99-7b44-49e6-afd7-f097745d2186 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1734 microversion: 2.1 time: 0.150248 Sep 13 01:22:22.792000 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 241/481] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:22 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:23.589487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d0052745-81fc-4816-91bc-ecfa5adb17d4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:23.590615 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d0052745-81fc-4816-91bc-ecfa5adb17d4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:23.597118 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d0052745-81fc-4816-91bc-ecfa5adb17d4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:23.597603 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d0052745-81fc-4816-91bc-ecfa5adb17d4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:23.598036 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d0052745-81fc-4816-91bc-ecfa5adb17d4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:23.598729 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d0052745-81fc-4816-91bc-ecfa5adb17d4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:23.599207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d0052745-81fc-4816-91bc-ecfa5adb17d4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:23.599633 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d0052745-81fc-4816-91bc-ecfa5adb17d4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:23.723548 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d0052745-81fc-4816-91bc-ecfa5adb17d4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:23.731074 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d0052745-81fc-4816-91bc-ecfa5adb17d4 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.145397 Sep 13 01:22:23.731641 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 241/482] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:23 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:23.813712 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7e53ecc2-bc2e-49ef-867a-a5c70cc9d142 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:23.814323 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7e53ecc2-bc2e-49ef-867a-a5c70cc9d142 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:23.820837 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e53ecc2-bc2e-49ef-867a-a5c70cc9d142 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:23.821324 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e53ecc2-bc2e-49ef-867a-a5c70cc9d142 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:23.821764 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e53ecc2-bc2e-49ef-867a-a5c70cc9d142 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:23.822456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e53ecc2-bc2e-49ef-867a-a5c70cc9d142 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:23.822937 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e53ecc2-bc2e-49ef-867a-a5c70cc9d142 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:23.823364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7e53ecc2-bc2e-49ef-867a-a5c70cc9d142 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:23.953386 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7e53ecc2-bc2e-49ef-867a-a5c70cc9d142 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:23.955683 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:23.963194 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7e53ecc2-bc2e-49ef-867a-a5c70cc9d142 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1714 microversion: 2.1 time: 0.153373 Sep 13 01:22:23.963780 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 242/483] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:23 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:24.071098 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-48e918b0-f3bb-4f1c-9651-75b36c61db17 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:24.071597 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-48e918b0-f3bb-4f1c-9651-75b36c61db17 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:24.078087 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48e918b0-f3bb-4f1c-9651-75b36c61db17 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:24.078574 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48e918b0-f3bb-4f1c-9651-75b36c61db17 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:24.079060 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48e918b0-f3bb-4f1c-9651-75b36c61db17 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:24.079758 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48e918b0-f3bb-4f1c-9651-75b36c61db17 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:24.080217 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48e918b0-f3bb-4f1c-9651-75b36c61db17 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:24.080646 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48e918b0-f3bb-4f1c-9651-75b36c61db17 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:24.159293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-48e918b0-f3bb-4f1c-9651-75b36c61db17 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] HTTP exception thrown: Cannot 'detach_volume' instance d89f56d9-6326-419a-ad10-fb520d83ec2a while it is in vm_state rescued Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-48e918b0-f3bb-4f1c-9651-75b36c61db17 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Request method failure captured: Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: DELETE /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-volume_attachments/b3b62c9f-35ac-458d-b4bd-495ceca4ca00 HTTP/1.1 Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9p4yMnrVK5GewsWLbTcRAz16uSc9TtrMuEljQX8sg0PXiBEAwAlB55augWK15AhNuOWCJg7_s89STcx-xwzZQh-CvS_k-5n7S0zKWbadfn4euhiUxAhZtEB4z7zlDtF2ivu7J04PPQiqOpRhilIzjzrHVHn7cC4gXETDbD4QP7c8NI Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: a84dd36fe9484f41bc2f0d7da4e47c13 Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:22:24.161058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:22:24.162604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a84dd36fe9484f41bc2f0d7da4e47c13"}]}] Sep 13 01:22:24.162604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:22:24.162604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: a84dd36fe9484f41bc2f0d7da4e47c13 Sep 13 01:22:24.162604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:22:24.162604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-ServerRescueNegativeTestJSON-293179200-project Sep 13 01:22:24.162604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:22:24.162604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:22:24.162604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 0c5dcfa5794843a5896fa051a4554e1f Sep 13 01:22:24.162604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-ServerRescueNegativeTestJSON-293179200-project Sep 13 01:22:24.162604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:22:24.162604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Cannot 'detach_volume' instance d89f56d9-6326-419a-ad10-fb520d83ec2a while it is in vm_state rescued Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'server_id': 'd89f56d9-6326-419a-ad10-fb520d83ec2a', 'id': 'b3b62c9f-35ac-458d-b4bd-495ceca4ca00'} Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d89f56d9-6326-419a-ad10-fb520d83ec2a in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:22:24.163506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d89f56d9-6326-419a-ad10-fb520d83ec2a while it is in vm_state rescued Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d89f56d9-6326-419a-ad10-fb520d83ec2a while it is in vm_state rescued Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:24.164798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-48e918b0-f3bb-4f1c-9651-75b36c61db17 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Returning 409 to user: Cannot 'detach_volume' instance d89f56d9-6326-419a-ad10-fb520d83ec2a while it is in vm_state rescued {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:22:24.165751 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-48e918b0-f3bb-4f1c-9651-75b36c61db17 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-volume_attachments/b3b62c9f-35ac-458d-b4bd-495ceca4ca00" status: 409 len: 152 microversion: 2.1 time: 0.095502 Sep 13 01:22:24.165751 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 242/484] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 01:22:24 2022] DELETE /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-volume_attachments/b3b62c9f-35ac-458d-b4bd-495ceca4ca00 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 13 01:22:24.171507 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c3669ef0-0ec3-4890-939f-2bb8eaa41ece tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:24.172040 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c3669ef0-0ec3-4890-939f-2bb8eaa41ece tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:24.179083 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3669ef0-0ec3-4890-939f-2bb8eaa41ece tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:24.179566 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3669ef0-0ec3-4890-939f-2bb8eaa41ece tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:24.180005 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3669ef0-0ec3-4890-939f-2bb8eaa41ece tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:24.180707 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3669ef0-0ec3-4890-939f-2bb8eaa41ece tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:24.181155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3669ef0-0ec3-4890-939f-2bb8eaa41ece tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:24.181579 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c3669ef0-0ec3-4890-939f-2bb8eaa41ece tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:24.244747 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c3669ef0-0ec3-4890-939f-2bb8eaa41ece tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "POST /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/action" status: 202 len: 0 microversion: 2.1 time: 0.076931 Sep 13 01:22:24.248723 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 243/485] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:22:24 2022] POST /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:22:24.254192 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4716c703-7f00-48c2-a0fe-9a429f64c0a4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:24.254806 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4716c703-7f00-48c2-a0fe-9a429f64c0a4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:24.264292 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4716c703-7f00-48c2-a0fe-9a429f64c0a4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:24.264834 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4716c703-7f00-48c2-a0fe-9a429f64c0a4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:24.265350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4716c703-7f00-48c2-a0fe-9a429f64c0a4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:24.266076 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4716c703-7f00-48c2-a0fe-9a429f64c0a4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:24.266529 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4716c703-7f00-48c2-a0fe-9a429f64c0a4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:24.266988 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4716c703-7f00-48c2-a0fe-9a429f64c0a4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:24.479307 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4716c703-7f00-48c2-a0fe-9a429f64c0a4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:24.487914 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4716c703-7f00-48c2-a0fe-9a429f64c0a4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1722 microversion: 2.1 time: 0.237641 Sep 13 01:22:24.488487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 243/486] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:24 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:24.754020 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9a1fb7a0-18ae-42f1-b6b0-60edbac9fe2b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:24.754767 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9a1fb7a0-18ae-42f1-b6b0-60edbac9fe2b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:24.760808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a1fb7a0-18ae-42f1-b6b0-60edbac9fe2b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:24.761287 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a1fb7a0-18ae-42f1-b6b0-60edbac9fe2b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:24.761721 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a1fb7a0-18ae-42f1-b6b0-60edbac9fe2b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:24.762450 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a1fb7a0-18ae-42f1-b6b0-60edbac9fe2b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:24.762916 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a1fb7a0-18ae-42f1-b6b0-60edbac9fe2b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:24.763334 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9a1fb7a0-18ae-42f1-b6b0-60edbac9fe2b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:24.893631 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9a1fb7a0-18ae-42f1-b6b0-60edbac9fe2b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:24.901396 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9a1fb7a0-18ae-42f1-b6b0-60edbac9fe2b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.151620 Sep 13 01:22:24.901955 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 244/487] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:24 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:25.511642 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3fc4192e-4ccd-4a82-bcb8-0e0d043820cc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:25.512769 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3fc4192e-4ccd-4a82-bcb8-0e0d043820cc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:25.519225 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3fc4192e-4ccd-4a82-bcb8-0e0d043820cc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:25.519700 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3fc4192e-4ccd-4a82-bcb8-0e0d043820cc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:25.520129 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3fc4192e-4ccd-4a82-bcb8-0e0d043820cc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:25.520809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3fc4192e-4ccd-4a82-bcb8-0e0d043820cc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:25.521257 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3fc4192e-4ccd-4a82-bcb8-0e0d043820cc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:25.521674 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3fc4192e-4ccd-4a82-bcb8-0e0d043820cc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:25.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3fc4192e-4ccd-4a82-bcb8-0e0d043820cc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:25.655158 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3fc4192e-4ccd-4a82-bcb8-0e0d043820cc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1722 microversion: 2.1 time: 0.147363 Sep 13 01:22:25.655723 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 244/488] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:25 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:25.924904 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7449743e-963f-4d36-8ec0-c79cbb5113e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:25.925505 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7449743e-963f-4d36-8ec0-c79cbb5113e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:25.931831 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7449743e-963f-4d36-8ec0-c79cbb5113e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:25.932308 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7449743e-963f-4d36-8ec0-c79cbb5113e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:25.932739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7449743e-963f-4d36-8ec0-c79cbb5113e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:25.933420 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7449743e-963f-4d36-8ec0-c79cbb5113e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:25.934748 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7449743e-963f-4d36-8ec0-c79cbb5113e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:25.935196 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7449743e-963f-4d36-8ec0-c79cbb5113e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:26.061192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7449743e-963f-4d36-8ec0-c79cbb5113e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:26.068750 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7449743e-963f-4d36-8ec0-c79cbb5113e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.147624 Sep 13 01:22:26.069312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 245/489] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:25 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:26.677903 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-127a918d-19c8-42ca-a275-b98f17a1c538 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:26.678431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-127a918d-19c8-42ca-a275-b98f17a1c538 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:26.685079 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-127a918d-19c8-42ca-a275-b98f17a1c538 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:26.685553 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-127a918d-19c8-42ca-a275-b98f17a1c538 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:26.685983 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-127a918d-19c8-42ca-a275-b98f17a1c538 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:26.687599 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-127a918d-19c8-42ca-a275-b98f17a1c538 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:26.687599 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-127a918d-19c8-42ca-a275-b98f17a1c538 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:26.687599 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-127a918d-19c8-42ca-a275-b98f17a1c538 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:26.815497 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-127a918d-19c8-42ca-a275-b98f17a1c538 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:26.823595 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-127a918d-19c8-42ca-a275-b98f17a1c538 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1722 microversion: 2.1 time: 0.149654 Sep 13 01:22:26.824644 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 245/490] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:26 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:27.091485 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d3bd3c9f-d845-47b9-b229-be6a89a6116b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:27.092091 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d3bd3c9f-d845-47b9-b229-be6a89a6116b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:27.098397 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d3bd3c9f-d845-47b9-b229-be6a89a6116b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:27.098905 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d3bd3c9f-d845-47b9-b229-be6a89a6116b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:27.099344 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d3bd3c9f-d845-47b9-b229-be6a89a6116b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:27.100069 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d3bd3c9f-d845-47b9-b229-be6a89a6116b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:27.100550 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d3bd3c9f-d845-47b9-b229-be6a89a6116b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:27.100972 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d3bd3c9f-d845-47b9-b229-be6a89a6116b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:27.226113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d3bd3c9f-d845-47b9-b229-be6a89a6116b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:27.233955 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d3bd3c9f-d845-47b9-b229-be6a89a6116b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1675 microversion: 2.1 time: 0.146275 Sep 13 01:22:27.234524 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 246/491] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:27 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:27.846822 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8e7d40e5-0bec-41f6-9261-d4bf97b7a5ac tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:27.847455 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-8e7d40e5-0bec-41f6-9261-d4bf97b7a5ac tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:27.853814 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8e7d40e5-0bec-41f6-9261-d4bf97b7a5ac tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:27.854295 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8e7d40e5-0bec-41f6-9261-d4bf97b7a5ac tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:27.854732 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8e7d40e5-0bec-41f6-9261-d4bf97b7a5ac tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:27.855492 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8e7d40e5-0bec-41f6-9261-d4bf97b7a5ac tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:27.855947 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8e7d40e5-0bec-41f6-9261-d4bf97b7a5ac tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:27.857014 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8e7d40e5-0bec-41f6-9261-d4bf97b7a5ac tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:27.986762 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-8e7d40e5-0bec-41f6-9261-d4bf97b7a5ac tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:27.994891 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-8e7d40e5-0bec-41f6-9261-d4bf97b7a5ac tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1728 microversion: 2.1 time: 0.151916 Sep 13 01:22:27.995466 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 246/492] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:27 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1728 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:28.017310 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-43211317-403c-45ca-b85b-f2b4c76d0e04 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:28.017800 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-43211317-403c-45ca-b85b-f2b4c76d0e04 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:28.023719 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-43211317-403c-45ca-b85b-f2b4c76d0e04 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:28.024258 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-43211317-403c-45ca-b85b-f2b4c76d0e04 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:28.024738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-43211317-403c-45ca-b85b-f2b4c76d0e04 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:28.025419 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-43211317-403c-45ca-b85b-f2b4c76d0e04 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:28.025872 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-43211317-403c-45ca-b85b-f2b4c76d0e04 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:28.026292 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-43211317-403c-45ca-b85b-f2b4c76d0e04 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:28.100148 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-43211317-403c-45ca-b85b-f2b4c76d0e04 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.086651 Sep 13 01:22:28.100761 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 247/493] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 01:22:28 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:22:28.257691 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-96d19c7a-927c-4866-b760-fd67a3ad18c0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:28.258832 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-96d19c7a-927c-4866-b760-fd67a3ad18c0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:28.266602 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-96d19c7a-927c-4866-b760-fd67a3ad18c0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:28.267125 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-96d19c7a-927c-4866-b760-fd67a3ad18c0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:28.268257 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-96d19c7a-927c-4866-b760-fd67a3ad18c0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:28.268257 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-96d19c7a-927c-4866-b760-fd67a3ad18c0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:28.268747 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-96d19c7a-927c-4866-b760-fd67a3ad18c0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:28.269122 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-96d19c7a-927c-4866-b760-fd67a3ad18c0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:28.398460 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-96d19c7a-927c-4866-b760-fd67a3ad18c0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:28.400719 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=100 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:28.409721 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-96d19c7a-927c-4866-b760-fd67a3ad18c0 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1652 microversion: 2.1 time: 0.154768 Sep 13 01:22:28.419174 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 247/494] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:28 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1652 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:28.430112 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b44cc293-2c57-4ade-a2b7-02e702404e82 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:28.436294 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b44cc293-2c57-4ade-a2b7-02e702404e82 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:28.436767 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b44cc293-2c57-4ade-a2b7-02e702404e82 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:28.437195 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b44cc293-2c57-4ade-a2b7-02e702404e82 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:28.460934 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b44cc293-2c57-4ade-a2b7-02e702404e82 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Going to try to start instance {{(pid=120415) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 13 01:22:28.502830 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b44cc293-2c57-4ade-a2b7-02e702404e82 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "POST /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/action" status: 202 len: 0 microversion: 2.1 time: 0.076413 Sep 13 01:22:28.503444 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 248/495] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:22:28 2022] POST /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:22:28.511530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-6c1aa38a-25c9-484e-9510-de42ba992bce tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:28.512659 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-6c1aa38a-25c9-484e-9510-de42ba992bce tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:28.518628 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6c1aa38a-25c9-484e-9510-de42ba992bce tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:28.519229 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6c1aa38a-25c9-484e-9510-de42ba992bce tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:28.519640 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6c1aa38a-25c9-484e-9510-de42ba992bce tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:28.520371 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6c1aa38a-25c9-484e-9510-de42ba992bce tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:28.520791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6c1aa38a-25c9-484e-9510-de42ba992bce tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:28.521206 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6c1aa38a-25c9-484e-9510-de42ba992bce tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:28.692424 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6c1aa38a-25c9-484e-9510-de42ba992bce tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:28.701413 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-6c1aa38a-25c9-484e-9510-de42ba992bce tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1661 microversion: 2.1 time: 0.193624 Sep 13 01:22:28.702192 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 248/496] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:28 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1661 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:29.202542 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-ca2564cc-c4df-48f9-afe2-b68c8377a511 req-9d36f9da-ce3d-4b67-bd50-d1af9a4987a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89f56d9-6326-419a-ad10-fb520d83ec2a", "tag": "d4354f6f-2db0-4d03-a3d4-4ddab59e9460"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:29.212327 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-ca2564cc-c4df-48f9-afe2-b68c8377a511 req-9d36f9da-ce3d-4b67-bd50-d1af9a4987a0 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:29.213016 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-ca2564cc-c4df-48f9-afe2-b68c8377a511 req-9d36f9da-ce3d-4b67-bd50-d1af9a4987a0 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:29.213635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-ca2564cc-c4df-48f9-afe2-b68c8377a511 req-9d36f9da-ce3d-4b67-bd50-d1af9a4987a0 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:29.226285 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-ca2564cc-c4df-48f9-afe2-b68c8377a511 req-9d36f9da-ce3d-4b67-bd50-d1af9a4987a0 service nova] Creating event network-changed:d4354f6f-2db0-4d03-a3d4-4ddab59e9460 for instance d89f56d9-6326-419a-ad10-fb520d83ec2a on hv-cinder-85694 Sep 13 01:22:29.231917 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-ca2564cc-c4df-48f9-afe2-b68c8377a511 req-9d36f9da-ce3d-4b67-bd50-d1af9a4987a0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033871 Sep 13 01:22:29.232616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 249/497] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:22:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:22:29.724350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a8eb5369-7e4a-4701-bdcc-304a4c789f35 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:29.724986 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a8eb5369-7e4a-4701-bdcc-304a4c789f35 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:29.731728 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a8eb5369-7e4a-4701-bdcc-304a4c789f35 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:29.732224 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a8eb5369-7e4a-4701-bdcc-304a4c789f35 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:29.732658 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a8eb5369-7e4a-4701-bdcc-304a4c789f35 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:29.733369 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a8eb5369-7e4a-4701-bdcc-304a4c789f35 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:29.733822 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a8eb5369-7e4a-4701-bdcc-304a4c789f35 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:29.734262 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a8eb5369-7e4a-4701-bdcc-304a4c789f35 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:29.861257 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a8eb5369-7e4a-4701-bdcc-304a4c789f35 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:29.869451 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a8eb5369-7e4a-4701-bdcc-304a4c789f35 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1661 microversion: 2.1 time: 0.149137 Sep 13 01:22:29.870032 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 249/498] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:29 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1661 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:30.892843 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-86658835-f19d-4945-a3fb-aefd4c6ef2be tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:30.893531 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-86658835-f19d-4945-a3fb-aefd4c6ef2be tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:30.900061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-86658835-f19d-4945-a3fb-aefd4c6ef2be tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:30.900536 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-86658835-f19d-4945-a3fb-aefd4c6ef2be tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:30.900967 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-86658835-f19d-4945-a3fb-aefd4c6ef2be tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:30.901648 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-86658835-f19d-4945-a3fb-aefd4c6ef2be tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:30.902617 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-86658835-f19d-4945-a3fb-aefd4c6ef2be tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:30.903067 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-86658835-f19d-4945-a3fb-aefd4c6ef2be tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:31.030311 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-86658835-f19d-4945-a3fb-aefd4c6ef2be tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:31.037818 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-86658835-f19d-4945-a3fb-aefd4c6ef2be tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1665 microversion: 2.1 time: 0.149156 Sep 13 01:22:31.038374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 250/499] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:30 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1665 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:31.245520 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-ed4adf39-ac26-4527-ab20-4e0f47469742 req-3db85c1b-a3a5-447e-950e-c8856d40b474 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d89f56d9-6326-419a-ad10-fb520d83ec2a", "tag": "d4354f6f-2db0-4d03-a3d4-4ddab59e9460"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:31.255439 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-ed4adf39-ac26-4527-ab20-4e0f47469742 req-3db85c1b-a3a5-447e-950e-c8856d40b474 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:31.255914 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-ed4adf39-ac26-4527-ab20-4e0f47469742 req-3db85c1b-a3a5-447e-950e-c8856d40b474 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:31.256345 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-ed4adf39-ac26-4527-ab20-4e0f47469742 req-3db85c1b-a3a5-447e-950e-c8856d40b474 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:31.269169 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-ed4adf39-ac26-4527-ab20-4e0f47469742 req-3db85c1b-a3a5-447e-950e-c8856d40b474 service nova] Creating event network-changed:d4354f6f-2db0-4d03-a3d4-4ddab59e9460 for instance d89f56d9-6326-419a-ad10-fb520d83ec2a on hv-cinder-85694 Sep 13 01:22:31.274006 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-ed4adf39-ac26-4527-ab20-4e0f47469742 req-3db85c1b-a3a5-447e-950e-c8856d40b474 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032159 Sep 13 01:22:31.274575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 250/500] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:22:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:22:33.843281 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ea2c7579-229f-459e-99d3-9942e647c50d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:33.843866 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ea2c7579-229f-459e-99d3-9942e647c50d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:33.846294 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=46 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:33.851458 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea2c7579-229f-459e-99d3-9942e647c50d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:33.851937 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea2c7579-229f-459e-99d3-9942e647c50d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:33.852393 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea2c7579-229f-459e-99d3-9942e647c50d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:33.853079 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea2c7579-229f-459e-99d3-9942e647c50d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:33.853523 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea2c7579-229f-459e-99d3-9942e647c50d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:33.853940 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ea2c7579-229f-459e-99d3-9942e647c50d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:33.885636 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ea2c7579-229f-459e-99d3-9942e647c50d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/os-volume_attachments/394264f5-b7be-4aa2-a951-01e3ec62450e" status: 200 len: 194 microversion: 2.20 time: 0.046307 Sep 13 01:22:33.886208 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 251/501] 10.222.0.15 () {60 vars in 1454 bytes} [Tue Sep 13 01:22:33 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/os-volume_attachments/394264f5-b7be-4aa2-a951-01e3ec62450e => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:22:33.955306 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4d0bd4e0-d112-4145-bbc5-15817757ebe1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:33.955884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4d0bd4e0-d112-4145-bbc5-15817757ebe1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:33.961871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d0bd4e0-d112-4145-bbc5-15817757ebe1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:33.962349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d0bd4e0-d112-4145-bbc5-15817757ebe1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:33.962791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d0bd4e0-d112-4145-bbc5-15817757ebe1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:33.963500 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d0bd4e0-d112-4145-bbc5-15817757ebe1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:33.963952 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d0bd4e0-d112-4145-bbc5-15817757ebe1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:33.964374 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4d0bd4e0-d112-4145-bbc5-15817757ebe1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:34.043905 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-4d0bd4e0-d112-4145-bbc5-15817757ebe1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lazy-loading 'services' on Instance uuid 1677b90a-17f0-496f-8fce-ac573509c1ac {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:22:34.115432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4d0bd4e0-d112-4145-bbc5-15817757ebe1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/os-volume_attachments/394264f5-b7be-4aa2-a951-01e3ec62450e" status: 202 len: 0 microversion: 2.20 time: 0.165369 Sep 13 01:22:34.116043 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 251/502] 10.222.0.15 () {60 vars in 1457 bytes} [Tue Sep 13 01:22:33 2022] DELETE /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/os-volume_attachments/394264f5-b7be-4aa2-a951-01e3ec62450e => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:22:34.125239 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3fb04863-c4ae-4200-8469-8c7f0c452887 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:34.127427 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3fb04863-c4ae-4200-8469-8c7f0c452887 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:34.133578 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3fb04863-c4ae-4200-8469-8c7f0c452887 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:34.134186 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3fb04863-c4ae-4200-8469-8c7f0c452887 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:34.134665 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3fb04863-c4ae-4200-8469-8c7f0c452887 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:34.135397 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3fb04863-c4ae-4200-8469-8c7f0c452887 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:34.135869 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3fb04863-c4ae-4200-8469-8c7f0c452887 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:34.136308 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3fb04863-c4ae-4200-8469-8c7f0c452887 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:34.166975 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3fb04863-c4ae-4200-8469-8c7f0c452887 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046398 Sep 13 01:22:34.167546 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 252/503] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Sep 13 01:22:34 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:22:35.181429 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a5553c52-f7d6-4933-8c30-61427c7c2eee tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:35.183933 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a5553c52-f7d6-4933-8c30-61427c7c2eee tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:35.186486 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=48 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:35.191790 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5553c52-f7d6-4933-8c30-61427c7c2eee tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:35.192273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5553c52-f7d6-4933-8c30-61427c7c2eee tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:35.192705 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5553c52-f7d6-4933-8c30-61427c7c2eee tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:35.193391 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5553c52-f7d6-4933-8c30-61427c7c2eee tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:35.193842 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5553c52-f7d6-4933-8c30-61427c7c2eee tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:35.194261 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5553c52-f7d6-4933-8c30-61427c7c2eee tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:35.222611 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a5553c52-f7d6-4933-8c30-61427c7c2eee tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046182 Sep 13 01:22:35.223424 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 252/504] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Sep 13 01:22:35 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:35.296544 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-76942194-f9a7-4055-8961-1d7ffd90a273 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:35.297071 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-76942194-f9a7-4055-8961-1d7ffd90a273 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:35.304324 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76942194-f9a7-4055-8961-1d7ffd90a273 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:35.304804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76942194-f9a7-4055-8961-1d7ffd90a273 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:35.305340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76942194-f9a7-4055-8961-1d7ffd90a273 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:35.306318 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76942194-f9a7-4055-8961-1d7ffd90a273 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:35.306773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76942194-f9a7-4055-8961-1d7ffd90a273 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:35.307225 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-76942194-f9a7-4055-8961-1d7ffd90a273 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:35.332225 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-76942194-f9a7-4055-8961-1d7ffd90a273 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:22:35.415523 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-76942194-f9a7-4055-8961-1d7ffd90a273 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 204 len: 0 microversion: 2.20 time: 0.122424 Sep 13 01:22:35.415523 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 253/505] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Sep 13 01:22:35 2022] DELETE /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 01:22:35.424044 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-256dab1e-8515-4abc-8a8c-1dc23e931fed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:35.424654 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-256dab1e-8515-4abc-8a8c-1dc23e931fed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:35.430441 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-256dab1e-8515-4abc-8a8c-1dc23e931fed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:35.430983 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-256dab1e-8515-4abc-8a8c-1dc23e931fed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:35.431422 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-256dab1e-8515-4abc-8a8c-1dc23e931fed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:35.432165 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-256dab1e-8515-4abc-8a8c-1dc23e931fed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:35.432560 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-256dab1e-8515-4abc-8a8c-1dc23e931fed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:35.432977 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-256dab1e-8515-4abc-8a8c-1dc23e931fed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:35.559567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-256dab1e-8515-4abc-8a8c-1dc23e931fed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:35.567497 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-256dab1e-8515-4abc-8a8c-1dc23e931fed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:35.568935 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-256dab1e-8515-4abc-8a8c-1dc23e931fed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:35.570082 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-256dab1e-8515-4abc-8a8c-1dc23e931fed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.149923 Sep 13 01:22:35.570635 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 253/506] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:35 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:22:36.603427 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3a492986-6018-431c-93bc-1f42ef9e42fc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:36.604139 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3a492986-6018-431c-93bc-1f42ef9e42fc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:36.610586 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a492986-6018-431c-93bc-1f42ef9e42fc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:36.611126 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a492986-6018-431c-93bc-1f42ef9e42fc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:36.611559 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a492986-6018-431c-93bc-1f42ef9e42fc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:36.612235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a492986-6018-431c-93bc-1f42ef9e42fc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:36.612683 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a492986-6018-431c-93bc-1f42ef9e42fc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:36.613106 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3a492986-6018-431c-93bc-1f42ef9e42fc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:36.742075 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3a492986-6018-431c-93bc-1f42ef9e42fc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:36.750706 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3a492986-6018-431c-93bc-1f42ef9e42fc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:36.752199 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3a492986-6018-431c-93bc-1f42ef9e42fc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:36.753378 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3a492986-6018-431c-93bc-1f42ef9e42fc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1722 microversion: 2.20 time: 0.154351 Sep 13 01:22:36.753928 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 254/507] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:36 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:22:37.777631 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-80fb84d4-4d97-4746-81bb-30fbb26fdcb5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:37.778228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-80fb84d4-4d97-4746-81bb-30fbb26fdcb5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:37.784712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-80fb84d4-4d97-4746-81bb-30fbb26fdcb5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:37.785199 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-80fb84d4-4d97-4746-81bb-30fbb26fdcb5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:37.785637 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-80fb84d4-4d97-4746-81bb-30fbb26fdcb5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:37.786331 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-80fb84d4-4d97-4746-81bb-30fbb26fdcb5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:37.786782 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-80fb84d4-4d97-4746-81bb-30fbb26fdcb5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:37.787229 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-80fb84d4-4d97-4746-81bb-30fbb26fdcb5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:37.870968 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-80fb84d4-4d97-4746-81bb-30fbb26fdcb5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:37.880286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-80fb84d4-4d97-4746-81bb-30fbb26fdcb5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:37.881793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-80fb84d4-4d97-4746-81bb-30fbb26fdcb5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:37.883055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-80fb84d4-4d97-4746-81bb-30fbb26fdcb5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 200 len: 1655 microversion: 2.20 time: 0.109377 Sep 13 01:22:37.883618 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 254/508] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:37 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 1655 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:22:38.138453 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-b189b202-c29d-4638-9820-a903e6137ed5 req-911c910a-e909-4258-b428-2a8256da8f1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1677b90a-17f0-496f-8fce-ac573509c1ac", "name": "network-vif-deleted", "tag": "88cd16db-1d4f-46f0-9069-3f6713e3efbd"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:38.155891 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-b189b202-c29d-4638-9820-a903e6137ed5 req-911c910a-e909-4258-b428-2a8256da8f1d service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:38.156376 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-b189b202-c29d-4638-9820-a903e6137ed5 req-911c910a-e909-4258-b428-2a8256da8f1d service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:38.156808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-b189b202-c29d-4638-9820-a903e6137ed5 req-911c910a-e909-4258-b428-2a8256da8f1d service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:38.169583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-b189b202-c29d-4638-9820-a903e6137ed5 req-911c910a-e909-4258-b428-2a8256da8f1d service nova] Creating event network-vif-deleted:88cd16db-1d4f-46f0-9069-3f6713e3efbd for instance 1677b90a-17f0-496f-8fce-ac573509c1ac on hv-cinder-85694 Sep 13 01:22:38.174977 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-b189b202-c29d-4638-9820-a903e6137ed5 req-911c910a-e909-4258-b428-2a8256da8f1d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040118 Sep 13 01:22:38.175719 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 255/509] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:22:38.909315 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-538279a8-9eb1-462d-b1ed-8435e192fc29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:38.910001 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-538279a8-9eb1-462d-b1ed-8435e192fc29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:38.919455 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-538279a8-9eb1-462d-b1ed-8435e192fc29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:38.921236 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-538279a8-9eb1-462d-b1ed-8435e192fc29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:38.921600 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-538279a8-9eb1-462d-b1ed-8435e192fc29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:38.922311 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-538279a8-9eb1-462d-b1ed-8435e192fc29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:38.922768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-538279a8-9eb1-462d-b1ed-8435e192fc29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:38.923245 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-538279a8-9eb1-462d-b1ed-8435e192fc29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:38.938179 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-538279a8-9eb1-462d-b1ed-8435e192fc29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] HTTP exception thrown: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-538279a8-9eb1-462d-b1ed-8435e192fc29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Request method failure captured: Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac HTTP/1.1 Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9p6SlnnnBAuteeFon40mAkzRXkGPGxE4_AbViw0uwd8Kd3KbI-p6tPvUXILUweIcaGvQUFo-C6MkdTwq-kJBCo4Ab_fddWy1yRyQTawCrGLEmeM26TIGiHItGwl1WErDHu1XuCR8cG1314UHt9-ejdNNXDaSBIPSzvv1JYmNPTd1dU Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 7a9e1eee32f04f3cabd8219d36d2c6a7 Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:22:38.939871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:22:38.941575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}] Sep 13 01:22:38.941575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:22:38.941575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 7a9e1eee32f04f3cabd8219d36d2c6a7 Sep 13 01:22:38.941575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:22:38.941575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-AttachVolumeShelveTestJSON-587556596-project Sep 13 01:22:38.941575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:22:38.941575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:22:38.941575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: e2846ad486314958bb74af71b647c470 Sep 13 01:22:38.941575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-AttachVolumeShelveTestJSON-587556596-project Sep 13 01:22:38.941575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:22:38.941575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:22:38.941575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '1677b90a-17f0-496f-8fce-ac573509c1ac'} Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:22:38.942573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:22:38.944040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:38.945326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-538279a8-9eb1-462d-b1ed-8435e192fc29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Returning 404 to user: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:22:38.945326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-538279a8-9eb1-462d-b1ed-8435e192fc29 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 404 len: 111 microversion: 2.20 time: 0.036297 Sep 13 01:22:38.947123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 255/510] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:38 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 01:22:38.951204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-208664a1-14a2-4c4a-b9a1-8110017ea729 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '.version_select at 0x7fb05e52e700>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:38.972602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-208664a1-14a2-4c4a-b9a1-8110017ea729 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-607275102" status: 204 len: 0 microversion: 2.20 time: 0.025843 Sep 13 01:22:38.973316 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 256/511] 10.222.0.15 () {60 vars in 1259 bytes} [Tue Sep 13 01:22:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-607275102 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 01:22:39.599201 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4dee3896-c6ba-45cc-9b5d-e6bde1d184e3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Action: 'create', calling method: .version_select at 0x7fb05e38fa60>, body: {"keypair": {"name": "tempest-keypair-695639002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDVODIUoQPxKjCSdFI645ltflMJzIC84zfMRlKYDpeNc6YWNRT8XD7Q1Dn59LoSEhw5hpgUcD1JPy5cWlCQtFFQV8HTNsuicQeL83vEfpbLzRzhLaytYgyWfwTE0dGMgfA=="}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:39.614699 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-4dee3896-c6ba-45cc-9b5d-e6bde1d184e3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Getting quotas for project 7a9e1eee32f04f3cabd8219d36d2c6a7. Resources: {'key_pairs'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:22:39.618699 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-4dee3896-c6ba-45cc-9b5d-e6bde1d184e3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Getting quotas for user e2846ad486314958bb74af71b647c470 and project 7a9e1eee32f04f3cabd8219d36d2c6a7. Resources: {'key_pairs'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:22:39.640724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4dee3896-c6ba-45cc-9b5d-e6bde1d184e3 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.045484 Sep 13 01:22:39.641446 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 256/512] 10.222.0.15 () {62 vars in 1200 bytes} [Tue Sep 13 01:22:39 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 47 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 13 01:22:40.893316 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1997311023", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47cc024b-679e-42c4-bf2a-2407e9c9e294"}], "security_groups": [{"name": "tempest-securitygroup--428379477"}], "key_name": "tempest-keypair-695639002", "user_data": "}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:40.996118 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] validate_networks() for [('47cc024b-679e-42c4-bf2a-2407e9c9e294', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:22:41.357006 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:22:41.357432 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:22:41.357918 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:22:41.358344 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:22:41.358750 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:22:41.367468 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:41.367944 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:41.368367 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:41.369081 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:41.369527 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:41.369942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:41.386721 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Getting quotas for project 7a9e1eee32f04f3cabd8219d36d2c6a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:22:41.390689 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Getting quotas for user e2846ad486314958bb74af71b647c470 and project 7a9e1eee32f04f3cabd8219d36d2c6a7. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:22:41.401402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:22:41.404321 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:22:41.452631 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2146355e-ebe2-41c5-8eb8-577e96902e98 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.563886 Sep 13 01:22:41.453202 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 257/513] 10.222.0.15 () {62 vars in 1188 bytes} [Tue Sep 13 01:22:40 2022] POST /compute/v2.1/servers => generated 401 bytes in 566 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 13 01:22:41.464157 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-77e6345a-7d4d-4ae9-b8f3-6cbba9e2912d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:41.464780 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-77e6345a-7d4d-4ae9-b8f3-6cbba9e2912d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:41.518183 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-77e6345a-7d4d-4ae9-b8f3-6cbba9e2912d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:41.525510 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-77e6345a-7d4d-4ae9-b8f3-6cbba9e2912d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:41.526986 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-77e6345a-7d4d-4ae9-b8f3-6cbba9e2912d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:41.528605 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-77e6345a-7d4d-4ae9-b8f3-6cbba9e2912d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1281 microversion: 2.20 time: 0.068338 Sep 13 01:22:41.529168 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 257/514] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:41 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:22:42.078161 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-df27c050-05b9-4ba3-8ee6-08c9861311af tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:42.078713 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-df27c050-05b9-4ba3-8ee6-08c9861311af tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:42.085082 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df27c050-05b9-4ba3-8ee6-08c9861311af tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:42.085668 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df27c050-05b9-4ba3-8ee6-08c9861311af tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:42.086170 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df27c050-05b9-4ba3-8ee6-08c9861311af tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:42.086951 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df27c050-05b9-4ba3-8ee6-08c9861311af tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:42.087478 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df27c050-05b9-4ba3-8ee6-08c9861311af tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:42.087906 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df27c050-05b9-4ba3-8ee6-08c9861311af tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:42.111501 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-df27c050-05b9-4ba3-8ee6-08c9861311af tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76/ips" status: 200 len: 149 microversion: 2.1 time: 0.038300 Sep 13 01:22:42.112078 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 258/515] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 01:22:42 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:22:42.124367 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0b697a92-1405-4b94-9049-a6bb129eb9a7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cbc46b1-fa3e-4217-afa8-f1250e3237a1"}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:42.126806 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0b697a92-1405-4b94-9049-a6bb129eb9a7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:42.132591 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b697a92-1405-4b94-9049-a6bb129eb9a7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:42.133323 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b697a92-1405-4b94-9049-a6bb129eb9a7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:42.133764 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b697a92-1405-4b94-9049-a6bb129eb9a7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:42.134453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b697a92-1405-4b94-9049-a6bb129eb9a7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:42.134926 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b697a92-1405-4b94-9049-a6bb129eb9a7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:42.135344 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b697a92-1405-4b94-9049-a6bb129eb9a7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:42.216756 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-0b697a92-1405-4b94-9049-a6bb129eb9a7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Invalid volume: volume 9cbc46b1-fa3e-4217-afa8-f1250e3237a1 is already attached to instances: 47f2cc02-f632-47e6-8eae-b39a67ec2bab Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0b697a92-1405-4b94-9049-a6bb129eb9a7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: POST /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76/os-volume_attachments HTTP/1.1 Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 74 Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:22:42.218375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:22:42.219884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:22:42.219884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:22:42.219884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:22:42.219884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:22:42.219884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:22:42.219884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:22:42.219884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:22:42.219884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:22:42.219884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:22:42.219884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Sep 13 01:22:42.219884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {"volumeAttachment": {"volumeId": "9cbc46b1-fa3e-4217-afa8-f1250e3237a1"}} Sep 13 01:22:42.219884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Invalid volume: volume 9cbc46b1-fa3e-4217-afa8-f1250e3237a1 is already attached to instances: 47f2cc02-f632-47e6-8eae-b39a67ec2bab Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'server_id': 'c255cb11-a9fd-46ce-8618-2177ad7f3f76', 'body': {'volumeAttachment': {'volumeId': '9cbc46b1-fa3e-4217-afa8-f1250e3237a1'}}} Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 9cbc46b1-fa3e-4217-afa8-f1250e3237a1 is already attached to instances: 47f2cc02-f632-47e6-8eae-b39a67ec2bab Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:42.221504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 9cbc46b1-fa3e-4217-afa8-f1250e3237a1 is already attached to instances: 47f2cc02-f632-47e6-8eae-b39a67ec2bab Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:42.222941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:22:42.224352 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:22:42.224352 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:22:42.224352 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:22:42.224352 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 9cbc46b1-fa3e-4217-afa8-f1250e3237a1 is already attached to instances: 47f2cc02-f632-47e6-8eae-b39a67ec2bab Sep 13 01:22:42.224352 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:22:42.224352 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0b697a92-1405-4b94-9049-a6bb129eb9a7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 400 to user: Invalid volume: volume 9cbc46b1-fa3e-4217-afa8-f1250e3237a1 is already attached to instances: 47f2cc02-f632-47e6-8eae-b39a67ec2bab {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:22:42.224352 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0b697a92-1405-4b94-9049-a6bb129eb9a7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "POST /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.100058 Sep 13 01:22:42.224352 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 258/516] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:22:42 2022] POST /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 01:22:42.230061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0ebaefb7-d627-4764-9f83-edd073e7108e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:42.230670 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0ebaefb7-d627-4764-9f83-edd073e7108e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:42.236667 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ebaefb7-d627-4764-9f83-edd073e7108e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:42.237240 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ebaefb7-d627-4764-9f83-edd073e7108e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:42.237681 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ebaefb7-d627-4764-9f83-edd073e7108e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:42.238369 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ebaefb7-d627-4764-9f83-edd073e7108e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:42.238824 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ebaefb7-d627-4764-9f83-edd073e7108e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:42.239273 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ebaefb7-d627-4764-9f83-edd073e7108e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:42.254236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:42.267256 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0ebaefb7-d627-4764-9f83-edd073e7108e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:22:42.344055 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0ebaefb7-d627-4764-9f83-edd073e7108e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 204 len: 0 microversion: 2.1 time: 0.117561 Sep 13 01:22:42.344808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 259/517] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:22:42 2022] DELETE /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:22:42.353505 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-be137359-651c-479a-9146-ae38928bb2d4 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:42.355053 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-be137359-651c-479a-9146-ae38928bb2d4 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:42.362391 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be137359-651c-479a-9146-ae38928bb2d4 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:42.362911 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be137359-651c-479a-9146-ae38928bb2d4 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:42.363355 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be137359-651c-479a-9146-ae38928bb2d4 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:42.364055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be137359-651c-479a-9146-ae38928bb2d4 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:42.364511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be137359-651c-479a-9146-ae38928bb2d4 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:42.364937 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be137359-651c-479a-9146-ae38928bb2d4 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:42.495056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-be137359-651c-479a-9146-ae38928bb2d4 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:42.503213 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-be137359-651c-479a-9146-ae38928bb2d4 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1681 microversion: 2.1 time: 0.154314 Sep 13 01:22:42.503766 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 259/518] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:42 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:42.553633 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a9b0729b-3cad-4518-813f-d5ca644870c6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:42.554454 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a9b0729b-3cad-4518-813f-d5ca644870c6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:42.561401 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9b0729b-3cad-4518-813f-d5ca644870c6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:42.561970 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9b0729b-3cad-4518-813f-d5ca644870c6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:42.562443 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9b0729b-3cad-4518-813f-d5ca644870c6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:42.563245 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9b0729b-3cad-4518-813f-d5ca644870c6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:42.564372 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9b0729b-3cad-4518-813f-d5ca644870c6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:42.564372 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a9b0729b-3cad-4518-813f-d5ca644870c6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:42.625106 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a9b0729b-3cad-4518-813f-d5ca644870c6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:42.632944 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a9b0729b-3cad-4518-813f-d5ca644870c6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:42.634366 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a9b0729b-3cad-4518-813f-d5ca644870c6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:42.635484 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a9b0729b-3cad-4518-813f-d5ca644870c6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1333 microversion: 2.20 time: 0.086126 Sep 13 01:22:42.636032 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 260/519] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:42 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1333 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:22:43.525497 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e0df7ab0-9478-40bb-b0de-a510104ba12b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:43.526112 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-e0df7ab0-9478-40bb-b0de-a510104ba12b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:43.533294 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0df7ab0-9478-40bb-b0de-a510104ba12b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:43.533775 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0df7ab0-9478-40bb-b0de-a510104ba12b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:43.534205 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0df7ab0-9478-40bb-b0de-a510104ba12b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:43.534922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0df7ab0-9478-40bb-b0de-a510104ba12b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:43.535368 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0df7ab0-9478-40bb-b0de-a510104ba12b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:43.535783 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0df7ab0-9478-40bb-b0de-a510104ba12b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:43.660147 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-70bca99a-25d5-40ba-aaeb-84bac7bbd3ae tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:43.661405 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-70bca99a-25d5-40ba-aaeb-84bac7bbd3ae tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:43.668750 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70bca99a-25d5-40ba-aaeb-84bac7bbd3ae tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:43.669523 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70bca99a-25d5-40ba-aaeb-84bac7bbd3ae tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:43.670029 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70bca99a-25d5-40ba-aaeb-84bac7bbd3ae tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:43.670826 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70bca99a-25d5-40ba-aaeb-84bac7bbd3ae tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:43.671404 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70bca99a-25d5-40ba-aaeb-84bac7bbd3ae tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:43.671831 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-70bca99a-25d5-40ba-aaeb-84bac7bbd3ae tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:43.674469 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-e0df7ab0-9478-40bb-b0de-a510104ba12b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:43.684441 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-e0df7ab0-9478-40bb-b0de-a510104ba12b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1681 microversion: 2.1 time: 0.161978 Sep 13 01:22:43.686889 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 260/520] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:43 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:43.740780 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-70bca99a-25d5-40ba-aaeb-84bac7bbd3ae tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:43.749444 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-70bca99a-25d5-40ba-aaeb-84bac7bbd3ae tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:43.750892 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-70bca99a-25d5-40ba-aaeb-84bac7bbd3ae tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:43.751988 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-70bca99a-25d5-40ba-aaeb-84bac7bbd3ae tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1333 microversion: 2.20 time: 0.096246 Sep 13 01:22:43.752533 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 261/521] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:43 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1333 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:22:44.712681 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-19159727-c71c-4eb6-8fdb-2a4630ec748f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:44.713607 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-19159727-c71c-4eb6-8fdb-2a4630ec748f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:44.722578 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-19159727-c71c-4eb6-8fdb-2a4630ec748f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:44.724528 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-19159727-c71c-4eb6-8fdb-2a4630ec748f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:44.724976 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-19159727-c71c-4eb6-8fdb-2a4630ec748f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:44.726068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-19159727-c71c-4eb6-8fdb-2a4630ec748f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:44.726529 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-19159727-c71c-4eb6-8fdb-2a4630ec748f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:44.726977 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-19159727-c71c-4eb6-8fdb-2a4630ec748f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:44.777060 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e2c65f3d-524f-4a75-b93c-8b1cadd4df55 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:44.778221 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e2c65f3d-524f-4a75-b93c-8b1cadd4df55 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:44.785253 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2c65f3d-524f-4a75-b93c-8b1cadd4df55 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:44.785733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2c65f3d-524f-4a75-b93c-8b1cadd4df55 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:44.786164 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2c65f3d-524f-4a75-b93c-8b1cadd4df55 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:44.786880 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2c65f3d-524f-4a75-b93c-8b1cadd4df55 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:44.787329 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2c65f3d-524f-4a75-b93c-8b1cadd4df55 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:44.787751 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e2c65f3d-524f-4a75-b93c-8b1cadd4df55 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:44.849037 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e2c65f3d-524f-4a75-b93c-8b1cadd4df55 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:44.857302 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e2c65f3d-524f-4a75-b93c-8b1cadd4df55 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:44.858742 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e2c65f3d-524f-4a75-b93c-8b1cadd4df55 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:44.859865 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e2c65f3d-524f-4a75-b93c-8b1cadd4df55 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1339 microversion: 2.20 time: 0.086795 Sep 13 01:22:44.860444 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 262/522] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:44 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1339 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:22:44.984249 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-19159727-c71c-4eb6-8fdb-2a4630ec748f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:44.994349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-19159727-c71c-4eb6-8fdb-2a4630ec748f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1681 microversion: 2.1 time: 0.289433 Sep 13 01:22:44.994986 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 261/523] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:44 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1681 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:45.885686 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-02bef40e-c509-478f-ba04-0db552a41d25 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:45.886312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-02bef40e-c509-478f-ba04-0db552a41d25 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:45.892575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-02bef40e-c509-478f-ba04-0db552a41d25 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:45.893062 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-02bef40e-c509-478f-ba04-0db552a41d25 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:45.893503 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-02bef40e-c509-478f-ba04-0db552a41d25 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:45.894200 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-02bef40e-c509-478f-ba04-0db552a41d25 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:45.894655 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-02bef40e-c509-478f-ba04-0db552a41d25 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:45.895109 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-02bef40e-c509-478f-ba04-0db552a41d25 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:45.959900 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-02bef40e-c509-478f-ba04-0db552a41d25 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:45.968516 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-02bef40e-c509-478f-ba04-0db552a41d25 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:45.969948 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-02bef40e-c509-478f-ba04-0db552a41d25 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:45.971072 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-02bef40e-c509-478f-ba04-0db552a41d25 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1339 microversion: 2.20 time: 0.089397 Sep 13 01:22:45.971623 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 263/524] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:45 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1339 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:22:46.017870 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7d54dca7-1f1c-4918-8eb5-990262d6cf36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:46.018523 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7d54dca7-1f1c-4918-8eb5-990262d6cf36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:46.025001 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d54dca7-1f1c-4918-8eb5-990262d6cf36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:46.025572 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d54dca7-1f1c-4918-8eb5-990262d6cf36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:46.026106 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d54dca7-1f1c-4918-8eb5-990262d6cf36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:46.026814 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d54dca7-1f1c-4918-8eb5-990262d6cf36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:46.027296 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d54dca7-1f1c-4918-8eb5-990262d6cf36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:46.028263 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d54dca7-1f1c-4918-8eb5-990262d6cf36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:46.119899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7d54dca7-1f1c-4918-8eb5-990262d6cf36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:46.128448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7d54dca7-1f1c-4918-8eb5-990262d6cf36 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1613 microversion: 2.1 time: 0.114618 Sep 13 01:22:46.129298 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 262/525] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:46 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1613 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:46.288454 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-e0c2f465-c9a3-439a-93ea-f2df4e2cf543 req-d482bda6-add9-442a-b7e2-903b9944620d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c255cb11-a9fd-46ce-8618-2177ad7f3f76", "name": "network-vif-deleted", "tag": "55824feb-f6a5-4ec6-b3c3-0b46eea4735b"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:46.307584 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-e0c2f465-c9a3-439a-93ea-f2df4e2cf543 req-d482bda6-add9-442a-b7e2-903b9944620d service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:46.308116 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-e0c2f465-c9a3-439a-93ea-f2df4e2cf543 req-d482bda6-add9-442a-b7e2-903b9944620d service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:46.309010 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-e0c2f465-c9a3-439a-93ea-f2df4e2cf543 req-d482bda6-add9-442a-b7e2-903b9944620d service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:46.353633 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-e0c2f465-c9a3-439a-93ea-f2df4e2cf543 req-d482bda6-add9-442a-b7e2-903b9944620d service nova] Creating event network-vif-deleted:55824feb-f6a5-4ec6-b3c3-0b46eea4735b for instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 on hv-cinder-85694 Sep 13 01:22:46.363744 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-e0c2f465-c9a3-439a-93ea-f2df4e2cf543 req-d482bda6-add9-442a-b7e2-903b9944620d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079013 Sep 13 01:22:46.366702 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 264/526] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:22:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:22:46.996863 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5c387579-29b3-4b20-a9ce-b358e4dd5627 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:46.997478 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-5c387579-29b3-4b20-a9ce-b358e4dd5627 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:47.003570 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5c387579-29b3-4b20-a9ce-b358e4dd5627 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:47.004064 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5c387579-29b3-4b20-a9ce-b358e4dd5627 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:47.004503 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5c387579-29b3-4b20-a9ce-b358e4dd5627 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:47.005212 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5c387579-29b3-4b20-a9ce-b358e4dd5627 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:47.005670 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5c387579-29b3-4b20-a9ce-b358e4dd5627 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:47.006099 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5c387579-29b3-4b20-a9ce-b358e4dd5627 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:47.156805 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:47.157508 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:47.164465 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:47.164959 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:47.165400 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:47.166108 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:47.166561 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:47.170203 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:47.211551 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:47.212318 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:47.213003 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:47.213694 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lazy-loading 'fault' on Instance uuid c255cb11-a9fd-46ce-8618-2177ad7f3f76 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:22:47.265990 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5c387579-29b3-4b20-a9ce-b358e4dd5627 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:47.266585 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:47.276745 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fe199b30-58f6-4867-bbcc-5079e68c3480 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 200 len: 1331 microversion: 2.1 time: 0.124055 Sep 13 01:22:47.277858 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 265/527] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:47 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 1331 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:47.279445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5c387579-29b3-4b20-a9ce-b358e4dd5627 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:47.281046 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5c387579-29b3-4b20-a9ce-b358e4dd5627 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:47.282273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-5c387579-29b3-4b20-a9ce-b358e4dd5627 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1406 microversion: 2.20 time: 0.290025 Sep 13 01:22:47.282906 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 263/528] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:46 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1406 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:22:48.300803 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b6d489d4-ed65-43db-b68a-3a03ce3b860e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:48.301478 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b6d489d4-ed65-43db-b68a-3a03ce3b860e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:48.306525 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3cf820f0-ae9c-4f3c-9f9b-6f062f8cebd4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:48.307176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3cf820f0-ae9c-4f3c-9f9b-6f062f8cebd4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:48.308226 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6d489d4-ed65-43db-b68a-3a03ce3b860e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:48.309473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6d489d4-ed65-43db-b68a-3a03ce3b860e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:48.309910 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6d489d4-ed65-43db-b68a-3a03ce3b860e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:48.310622 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6d489d4-ed65-43db-b68a-3a03ce3b860e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:48.311485 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6d489d4-ed65-43db-b68a-3a03ce3b860e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:48.311884 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b6d489d4-ed65-43db-b68a-3a03ce3b860e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:48.314467 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3cf820f0-ae9c-4f3c-9f9b-6f062f8cebd4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:48.314989 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3cf820f0-ae9c-4f3c-9f9b-6f062f8cebd4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:48.315431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3cf820f0-ae9c-4f3c-9f9b-6f062f8cebd4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:48.316177 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3cf820f0-ae9c-4f3c-9f9b-6f062f8cebd4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:48.316625 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3cf820f0-ae9c-4f3c-9f9b-6f062f8cebd4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:48.317052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3cf820f0-ae9c-4f3c-9f9b-6f062f8cebd4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:48.330070 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-b6d489d4-ed65-43db-b68a-3a03ce3b860e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b6d489d4-ed65-43db-b68a-3a03ce3b860e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 HTTP/1.1 Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:22:48.331769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:22:48.333317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:22:48.333317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:22:48.333317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:22:48.333317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:22:48.333317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:22:48.333317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:22:48.333317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:22:48.333317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:22:48.333317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:22:48.333317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:22:48.333317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:22:48.333317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': 'c255cb11-a9fd-46ce-8618-2177ad7f3f76'} Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:22:48.334113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:22:48.335255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:22:48.336322 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b6d489d4-ed65-43db-b68a-3a03ce3b860e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 404 to user: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:22:48.336322 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b6d489d4-ed65-43db-b68a-3a03ce3b860e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 404 len: 111 microversion: 2.1 time: 0.036599 Sep 13 01:22:48.336322 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 266/529] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:48 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:22:48.341848 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-17f77c8a-e119-4a24-a8dd-ee5b3da6db06 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '.version_select at 0x7fb05e8710d0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:48.361241 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-17f77c8a-e119-4a24-a8dd-ee5b3da6db06 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-582127525" status: 202 len: 0 microversion: 2.1 time: 0.022892 Sep 13 01:22:48.361933 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 267/530] 10.222.0.15 () {58 vars in 1218 bytes} [Tue Sep 13 01:22:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-582127525 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:22:48.394064 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-fb8f6579-5698-4dd4-bacc-a3e5129f0ac1 req-2a76309f-2c80-4d5b-94ab-08f9515242d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d56cdc-0d80-4681-9384-b1df6e5a403d", "tag": "7eba6092-8d78-465f-a5ad-642414710fd4"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:48.413628 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-fb8f6579-5698-4dd4-bacc-a3e5129f0ac1 req-2a76309f-2c80-4d5b-94ab-08f9515242d8 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:48.414367 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-fb8f6579-5698-4dd4-bacc-a3e5129f0ac1 req-2a76309f-2c80-4d5b-94ab-08f9515242d8 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:48.414805 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-fb8f6579-5698-4dd4-bacc-a3e5129f0ac1 req-2a76309f-2c80-4d5b-94ab-08f9515242d8 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:48.426748 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-fb8f6579-5698-4dd4-bacc-a3e5129f0ac1 req-2a76309f-2c80-4d5b-94ab-08f9515242d8 service nova] Creating event network-changed:7eba6092-8d78-465f-a5ad-642414710fd4 for instance 29d56cdc-0d80-4681-9384-b1df6e5a403d on hv-cinder-85694 Sep 13 01:22:48.431807 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-fb8f6579-5698-4dd4-bacc-a3e5129f0ac1 req-2a76309f-2c80-4d5b-94ab-08f9515242d8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041659 Sep 13 01:22:48.432736 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 268/531] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:22:48.466734 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3cf820f0-ae9c-4f3c-9f9b-6f062f8cebd4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:48.475187 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3cf820f0-ae9c-4f3c-9f9b-6f062f8cebd4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:48.476725 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3cf820f0-ae9c-4f3c-9f9b-6f062f8cebd4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:48.477912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3cf820f0-ae9c-4f3c-9f9b-6f062f8cebd4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1406 microversion: 2.20 time: 0.175394 Sep 13 01:22:48.478535 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 264/532] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:48 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1406 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:22:49.271864 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f3dd4a59-6851-408e-ae33-0103323299e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:49.272447 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f3dd4a59-6851-408e-ae33-0103323299e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:49.279263 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3dd4a59-6851-408e-ae33-0103323299e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:49.279752 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3dd4a59-6851-408e-ae33-0103323299e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:49.280185 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3dd4a59-6851-408e-ae33-0103323299e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:49.280897 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3dd4a59-6851-408e-ae33-0103323299e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:49.281347 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3dd4a59-6851-408e-ae33-0103323299e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:49.281769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f3dd4a59-6851-408e-ae33-0103323299e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:49.405118 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-f3dd4a59-6851-408e-ae33-0103323299e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lazy-loading 'services' on Instance uuid 47f2cc02-f632-47e6-8eae-b39a67ec2bab {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:22:49.503220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5f0f18b9-103e-4d86-985b-b02c27492ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:49.504510 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-5f0f18b9-103e-4d86-985b-b02c27492ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:49.512038 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5f0f18b9-103e-4d86-985b-b02c27492ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:49.512553 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5f0f18b9-103e-4d86-985b-b02c27492ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:49.513154 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5f0f18b9-103e-4d86-985b-b02c27492ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:49.514032 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5f0f18b9-103e-4d86-985b-b02c27492ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:49.514650 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5f0f18b9-103e-4d86-985b-b02c27492ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:49.515129 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5f0f18b9-103e-4d86-985b-b02c27492ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:49.525507 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f3dd4a59-6851-408e-ae33-0103323299e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab/os-volume_attachments/9cbc46b1-fa3e-4217-afa8-f1250e3237a1" status: 202 len: 0 microversion: 2.1 time: 0.257710 Sep 13 01:22:49.526553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 269/533] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 01:22:49 2022] DELETE /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab/os-volume_attachments/9cbc46b1-fa3e-4217-afa8-f1250e3237a1 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:22:49.536737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e9ac8e7c-1f65-4ebc-adc4-e2e61b0c6d00 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:49.539566 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e9ac8e7c-1f65-4ebc-adc4-e2e61b0c6d00 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:49.548852 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9ac8e7c-1f65-4ebc-adc4-e2e61b0c6d00 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:49.549569 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9ac8e7c-1f65-4ebc-adc4-e2e61b0c6d00 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:49.550007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9ac8e7c-1f65-4ebc-adc4-e2e61b0c6d00 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:49.550706 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9ac8e7c-1f65-4ebc-adc4-e2e61b0c6d00 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:49.561417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9ac8e7c-1f65-4ebc-adc4-e2e61b0c6d00 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:49.561957 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e9ac8e7c-1f65-4ebc-adc4-e2e61b0c6d00 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:49.597452 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e9ac8e7c-1f65-4ebc-adc4-e2e61b0c6d00 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065185 Sep 13 01:22:49.601710 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 270/534] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:22:49 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:22:49.656423 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5f0f18b9-103e-4d86-985b-b02c27492ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:49.664537 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5f0f18b9-103e-4d86-985b-b02c27492ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:49.665986 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5f0f18b9-103e-4d86-985b-b02c27492ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:49.667132 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-5f0f18b9-103e-4d86-985b-b02c27492ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1406 microversion: 2.20 time: 0.167893 Sep 13 01:22:49.667695 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 265/535] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:49 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:22:50.610910 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cc0f6550-8750-4e76-876b-c427951d73a2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:50.613332 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cc0f6550-8750-4e76-876b-c427951d73a2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:50.620548 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc0f6550-8750-4e76-876b-c427951d73a2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:50.621431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc0f6550-8750-4e76-876b-c427951d73a2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:50.622239 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc0f6550-8750-4e76-876b-c427951d73a2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:50.624121 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc0f6550-8750-4e76-876b-c427951d73a2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:50.624724 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc0f6550-8750-4e76-876b-c427951d73a2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:50.625163 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc0f6550-8750-4e76-876b-c427951d73a2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:50.655074 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cc0f6550-8750-4e76-876b-c427951d73a2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048669 Sep 13 01:22:50.655636 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 271/536] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:22:50 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 01:22:50.691663 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-df677669-90dc-48fc-857e-0c5bf5462b39 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:50.692279 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-df677669-90dc-48fc-857e-0c5bf5462b39 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:50.698703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-df677669-90dc-48fc-857e-0c5bf5462b39 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:50.702917 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-df677669-90dc-48fc-857e-0c5bf5462b39 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:50.703421 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-df677669-90dc-48fc-857e-0c5bf5462b39 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:50.704155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-df677669-90dc-48fc-857e-0c5bf5462b39 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:50.704612 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-df677669-90dc-48fc-857e-0c5bf5462b39 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:50.705224 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-df677669-90dc-48fc-857e-0c5bf5462b39 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:50.719241 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6134f737-859f-4f54-a690-dbcf3a2831e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:50.719744 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6134f737-859f-4f54-a690-dbcf3a2831e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:50.725547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6134f737-859f-4f54-a690-dbcf3a2831e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:50.726028 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6134f737-859f-4f54-a690-dbcf3a2831e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:50.726464 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6134f737-859f-4f54-a690-dbcf3a2831e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:50.727252 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6134f737-859f-4f54-a690-dbcf3a2831e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:50.727711 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6134f737-859f-4f54-a690-dbcf3a2831e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:50.728134 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6134f737-859f-4f54-a690-dbcf3a2831e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:50.754110 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6134f737-859f-4f54-a690-dbcf3a2831e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:22:50.834883 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6134f737-859f-4f54-a690-dbcf3a2831e0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 204 len: 0 microversion: 2.1 time: 0.119340 Sep 13 01:22:50.835626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 272/537] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:22:50 2022] DELETE /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 01:22:50.844572 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c864b867-032c-4a65-8262-88dbf166a39c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:50.845291 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-df677669-90dc-48fc-857e-0c5bf5462b39 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:50.845445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c864b867-032c-4a65-8262-88dbf166a39c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:50.851861 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c864b867-032c-4a65-8262-88dbf166a39c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:50.852354 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c864b867-032c-4a65-8262-88dbf166a39c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:50.852792 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c864b867-032c-4a65-8262-88dbf166a39c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:50.853272 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-df677669-90dc-48fc-857e-0c5bf5462b39 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:50.853496 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c864b867-032c-4a65-8262-88dbf166a39c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:50.853952 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c864b867-032c-4a65-8262-88dbf166a39c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:50.854381 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c864b867-032c-4a65-8262-88dbf166a39c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:50.854708 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-df677669-90dc-48fc-857e-0c5bf5462b39 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:50.855863 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-df677669-90dc-48fc-857e-0c5bf5462b39 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1406 microversion: 2.20 time: 0.167999 Sep 13 01:22:50.856418 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 266/538] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:50 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:22:50.988210 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c864b867-032c-4a65-8262-88dbf166a39c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:50.995885 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c864b867-032c-4a65-8262-88dbf166a39c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1682 microversion: 2.1 time: 0.155715 Sep 13 01:22:50.996449 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 273/539] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:50 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:22:51.402321 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-5a296ebc-6358-4af0-b753-9f5465142019 req-630a0f5d-17d7-44b7-866f-d4c0b807e82c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d56cdc-0d80-4681-9384-b1df6e5a403d", "name": "network-vif-plugged", "status": "completed", "tag": "7eba6092-8d78-465f-a5ad-642414710fd4"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:51.414894 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-5a296ebc-6358-4af0-b753-9f5465142019 req-630a0f5d-17d7-44b7-866f-d4c0b807e82c service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:51.415391 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-5a296ebc-6358-4af0-b753-9f5465142019 req-630a0f5d-17d7-44b7-866f-d4c0b807e82c service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:51.415829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-5a296ebc-6358-4af0-b753-9f5465142019 req-630a0f5d-17d7-44b7-866f-d4c0b807e82c service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:51.420087 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:51.428342 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-5a296ebc-6358-4af0-b753-9f5465142019 req-630a0f5d-17d7-44b7-866f-d4c0b807e82c service nova] Creating event network-vif-plugged:7eba6092-8d78-465f-a5ad-642414710fd4 for instance 29d56cdc-0d80-4681-9384-b1df6e5a403d on hv-cinder-85694 Sep 13 01:22:51.433953 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-5a296ebc-6358-4af0-b753-9f5465142019 req-630a0f5d-17d7-44b7-866f-d4c0b807e82c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035399 Sep 13 01:22:51.434560 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 267/540] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:22:51.881046 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-db9e07ed-3e74-41f5-adf7-21a0d06d777d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:51.881651 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-db9e07ed-3e74-41f5-adf7-21a0d06d777d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:51.883629 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:51.884318 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=6 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:51.891298 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-db9e07ed-3e74-41f5-adf7-21a0d06d777d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:51.891777 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-db9e07ed-3e74-41f5-adf7-21a0d06d777d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:51.892205 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-db9e07ed-3e74-41f5-adf7-21a0d06d777d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:51.892884 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-db9e07ed-3e74-41f5-adf7-21a0d06d777d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:51.893332 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-db9e07ed-3e74-41f5-adf7-21a0d06d777d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:51.893749 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-db9e07ed-3e74-41f5-adf7-21a0d06d777d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:52.021057 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9820522f-d338-4d72-9748-9674bb24c962 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:52.022026 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9820522f-d338-4d72-9748-9674bb24c962 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:52.024475 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-db9e07ed-3e74-41f5-adf7-21a0d06d777d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:52.025741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=6 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:52.026919 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:52.030320 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9820522f-d338-4d72-9748-9674bb24c962 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:52.030838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9820522f-d338-4d72-9748-9674bb24c962 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:52.031325 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9820522f-d338-4d72-9748-9674bb24c962 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:52.032108 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9820522f-d338-4d72-9748-9674bb24c962 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:52.032586 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9820522f-d338-4d72-9748-9674bb24c962 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:52.033014 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9820522f-d338-4d72-9748-9674bb24c962 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:52.036337 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-db9e07ed-3e74-41f5-adf7-21a0d06d777d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:52.037767 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-db9e07ed-3e74-41f5-adf7-21a0d06d777d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:52.038883 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-db9e07ed-3e74-41f5-adf7-21a0d06d777d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1406 microversion: 2.20 time: 0.161716 Sep 13 01:22:52.039446 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 274/541] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:51 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:22:52.163513 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-9820522f-d338-4d72-9748-9674bb24c962 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:52.171621 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9820522f-d338-4d72-9748-9674bb24c962 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1682 microversion: 2.1 time: 0.154937 Sep 13 01:22:52.172197 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 268/542] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:52 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:22:53.063968 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bb4a32be-385f-4915-bfac-cecd64a50ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:53.064628 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bb4a32be-385f-4915-bfac-cecd64a50ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:53.072340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bb4a32be-385f-4915-bfac-cecd64a50ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:53.072907 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bb4a32be-385f-4915-bfac-cecd64a50ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:53.073347 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bb4a32be-385f-4915-bfac-cecd64a50ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:53.074043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bb4a32be-385f-4915-bfac-cecd64a50ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:53.074500 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bb4a32be-385f-4915-bfac-cecd64a50ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:53.074950 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bb4a32be-385f-4915-bfac-cecd64a50ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:53.196186 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4def3471-807f-4766-9330-8c2e264a5cb5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:53.197895 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4def3471-807f-4766-9330-8c2e264a5cb5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:53.205310 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4def3471-807f-4766-9330-8c2e264a5cb5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:53.205806 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4def3471-807f-4766-9330-8c2e264a5cb5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:53.206247 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4def3471-807f-4766-9330-8c2e264a5cb5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:53.206976 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4def3471-807f-4766-9330-8c2e264a5cb5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:53.207647 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4def3471-807f-4766-9330-8c2e264a5cb5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:53.207836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bb4a32be-385f-4915-bfac-cecd64a50ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:53.208079 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4def3471-807f-4766-9330-8c2e264a5cb5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:53.217494 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bb4a32be-385f-4915-bfac-cecd64a50ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:53.219190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bb4a32be-385f-4915-bfac-cecd64a50ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:53.220325 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bb4a32be-385f-4915-bfac-cecd64a50ab7 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1406 microversion: 2.20 time: 0.160360 Sep 13 01:22:53.223827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 275/543] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:53 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:22:53.660426 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4def3471-807f-4766-9330-8c2e264a5cb5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:53.667966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4def3471-807f-4766-9330-8c2e264a5cb5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1682 microversion: 2.1 time: 0.476173 Sep 13 01:22:53.668531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 269/544] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:53 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1682 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:53.888363 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-927f6ed6-93cd-4ee1-849b-9b3ccbefcb02 req-96eca9c5-1631-4946-ae4a-a8bc95de3532 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f2cc02-f632-47e6-8eae-b39a67ec2bab", "name": "network-vif-deleted", "tag": "1ce4a6ed-1a1c-4f8d-acb8-36d90bdf6dbf"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:53.897712 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-927f6ed6-93cd-4ee1-849b-9b3ccbefcb02 req-96eca9c5-1631-4946-ae4a-a8bc95de3532 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:53.898180 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-927f6ed6-93cd-4ee1-849b-9b3ccbefcb02 req-96eca9c5-1631-4946-ae4a-a8bc95de3532 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:53.898603 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-927f6ed6-93cd-4ee1-849b-9b3ccbefcb02 req-96eca9c5-1631-4946-ae4a-a8bc95de3532 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:53.909502 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-927f6ed6-93cd-4ee1-849b-9b3ccbefcb02 req-96eca9c5-1631-4946-ae4a-a8bc95de3532 service nova] Creating event network-vif-deleted:1ce4a6ed-1a1c-4f8d-acb8-36d90bdf6dbf for instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab on hv-cinder-85694 Sep 13 01:22:53.914240 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-927f6ed6-93cd-4ee1-849b-9b3ccbefcb02 req-96eca9c5-1631-4946-ae4a-a8bc95de3532 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029533 Sep 13 01:22:53.914819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 276/545] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:22:54.246498 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-2cb433e5-f397-45e3-9ae6-7997621acbeb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:54.248130 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-2cb433e5-f397-45e3-9ae6-7997621acbeb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:54.255454 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2cb433e5-f397-45e3-9ae6-7997621acbeb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:54.256269 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2cb433e5-f397-45e3-9ae6-7997621acbeb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:54.256969 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2cb433e5-f397-45e3-9ae6-7997621acbeb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:54.258034 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2cb433e5-f397-45e3-9ae6-7997621acbeb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:54.258819 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2cb433e5-f397-45e3-9ae6-7997621acbeb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:54.259512 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2cb433e5-f397-45e3-9ae6-7997621acbeb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:54.418149 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2cb433e5-f397-45e3-9ae6-7997621acbeb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:54.430477 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2cb433e5-f397-45e3-9ae6-7997621acbeb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:54.432009 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2cb433e5-f397-45e3-9ae6-7997621acbeb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:54.433172 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-2cb433e5-f397-45e3-9ae6-7997621acbeb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1597 microversion: 2.20 time: 0.191602 Sep 13 01:22:54.434138 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 270/546] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:22:54 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1597 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:22:54.458706 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-51af1d45-1d1a-47e5-8b58-bc8cd43f6dad tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:54.459313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-51af1d45-1d1a-47e5-8b58-bc8cd43f6dad tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:54.465770 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51af1d45-1d1a-47e5-8b58-bc8cd43f6dad tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:54.467178 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51af1d45-1d1a-47e5-8b58-bc8cd43f6dad tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:54.467812 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51af1d45-1d1a-47e5-8b58-bc8cd43f6dad tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:54.468529 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51af1d45-1d1a-47e5-8b58-bc8cd43f6dad tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:54.468985 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51af1d45-1d1a-47e5-8b58-bc8cd43f6dad tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:54.469412 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-51af1d45-1d1a-47e5-8b58-bc8cd43f6dad tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:54.554614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-51af1d45-1d1a-47e5-8b58-bc8cd43f6dad tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.100551 Sep 13 01:22:54.562757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 277/547] 10.222.0.15 () {60 vars in 1316 bytes} [Tue Sep 13 01:22:54 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/os-interface => generated 285 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:22:54.691793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:54.692406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:54.701294 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:54.701783 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:54.702219 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:54.702952 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:54.703411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:54.703857 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:54.736793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:54.737283 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:54.737725 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:54.738184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lazy-loading 'fault' on Instance uuid 47f2cc02-f632-47e6-8eae-b39a67ec2bab {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:22:54.797954 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:54.806083 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-be922adc-df8d-45fc-a5b7-1f4463a3f7fb tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 200 len: 1332 microversion: 2.1 time: 0.118052 Sep 13 01:22:54.806928 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 271/548] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:54 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 1332 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:55.830154 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a59bc3e6-27bb-4495-8d97-baa62d0c9dab tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:55.830931 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a59bc3e6-27bb-4495-8d97-baa62d0c9dab tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:55.836756 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a59bc3e6-27bb-4495-8d97-baa62d0c9dab tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:55.837239 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a59bc3e6-27bb-4495-8d97-baa62d0c9dab tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:55.837682 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a59bc3e6-27bb-4495-8d97-baa62d0c9dab tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:55.838369 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a59bc3e6-27bb-4495-8d97-baa62d0c9dab tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:55.838823 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a59bc3e6-27bb-4495-8d97-baa62d0c9dab tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:55.839270 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a59bc3e6-27bb-4495-8d97-baa62d0c9dab tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:55.852854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-a59bc3e6-27bb-4495-8d97-baa62d0c9dab tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a59bc3e6-27bb-4495-8d97-baa62d0c9dab tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab HTTP/1.1 Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:22:55.854473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:22:55.855965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:22:55.855965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:22:55.855965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:22:55.855965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:22:55.855965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:22:55.855965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:22:55.855965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:22:55.855965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:22:55.855965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:22:55.855965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:22:55.855965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:22:55.855965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '47f2cc02-f632-47e6-8eae-b39a67ec2bab'} Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:22:55.857417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:22:55.858537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:22:55.859571 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a59bc3e6-27bb-4495-8d97-baa62d0c9dab tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 404 to user: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:22:55.859571 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a59bc3e6-27bb-4495-8d97-baa62d0c9dab tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 404 len: 111 microversion: 2.1 time: 0.030113 Sep 13 01:22:55.859571 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 278/549] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:55 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:22:55.865242 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-78d0f162-71b7-4003-abb0-bfe2c2112106 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '.version_select at 0x7fb05e3f55e0>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:55.885714 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-78d0f162-71b7-4003-abb0-bfe2c2112106 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766917123" status: 202 len: 0 microversion: 2.1 time: 0.024198 Sep 13 01:22:55.886395 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 272/550] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Sep 13 01:22:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1766917123 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:22:55.931265 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-e42280bf-78ce-4d0a-bfc9-84936a78406b req-47c972df-e34c-4b4a-a544-76e26679bd87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29d56cdc-0d80-4681-9384-b1df6e5a403d", "tag": "7eba6092-8d78-465f-a5ad-642414710fd4"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:55.943207 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-e42280bf-78ce-4d0a-bfc9-84936a78406b req-47c972df-e34c-4b4a-a544-76e26679bd87 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:55.943685 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-e42280bf-78ce-4d0a-bfc9-84936a78406b req-47c972df-e34c-4b4a-a544-76e26679bd87 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:55.944104 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-e42280bf-78ce-4d0a-bfc9-84936a78406b req-47c972df-e34c-4b4a-a544-76e26679bd87 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:55.955704 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-e42280bf-78ce-4d0a-bfc9-84936a78406b req-47c972df-e34c-4b4a-a544-76e26679bd87 service nova] Creating event network-changed:7eba6092-8d78-465f-a5ad-642414710fd4 for instance 29d56cdc-0d80-4681-9384-b1df6e5a403d on hv-cinder-85694 Sep 13 01:22:55.961301 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-e42280bf-78ce-4d0a-bfc9-84936a78406b req-47c972df-e34c-4b4a-a544-76e26679bd87 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034263 Sep 13 01:22:55.961904 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 279/551] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:22:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:22:56.636792 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-825cd859-d3c5-4452-a484-366cc63de0f6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Action: 'create', calling method: .version_select at 0x7fb05e468c10>, body: {"keypair": {"name": "tempest-keypair-920275714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKUuJtJNgswcJWeKH/wFi9cPkY1T/ty0pg4TIh+hGSYj1Beju04Uc2QV4Bi9WOHOEau4WW2g66tV50ARG4XgW1xvjdv2lSuTlBzTGcxIH6rbLWuQywqBTQeJuj22+i3arg=="}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:56.651770 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-825cd859-d3c5-4452-a484-366cc63de0f6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for project 30ce8239a9b34af685743812ce53ef19. Resources: {'key_pairs'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:22:56.655634 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-825cd859-d3c5-4452-a484-366cc63de0f6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for user 776733af5b6a4115b2a11d67666a379d and project 30ce8239a9b34af685743812ce53ef19. Resources: {'key_pairs'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:22:56.677388 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-825cd859-d3c5-4452-a484-366cc63de0f6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044538 Sep 13 01:22:56.677981 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 273/552] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 01:22:56 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:22:57.789336 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1365726929", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed8fe8c3-8c67-4c53-9bb3-c1aeeaaaf18e"}], "security_groups": [{"name": "tempest-securitygroup--1339381579"}], "key_name": "tempest-keypair-920275714", "user_data": "}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:22:57.898228 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] validate_networks() for [('ed8fe8c3-8c67-4c53-9bb3-c1aeeaaaf18e', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:22:58.069061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:22:58.259464 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:22:58.259884 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:22:58.260349 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:22:58.260758 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:22:58.261156 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:22:58.269836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:58.270312 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:58.270741 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:58.271493 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:58.271939 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:58.272357 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:58.288405 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for project 30ce8239a9b34af685743812ce53ef19. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:22:58.292263 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for user 776733af5b6a4115b2a11d67666a379d and project 30ce8239a9b34af685743812ce53ef19. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:22:58.303385 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:22:58.305697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:22:58.354500 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e98c4ee5-4293-46e1-a2fe-b459da0d4e77 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.570094 Sep 13 01:22:58.355165 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 280/553] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:22:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 01:22:58.366743 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-fa3e0bb1-7b4d-4060-9924-beecb4f18da7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:58.367502 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-fa3e0bb1-7b4d-4060-9924-beecb4f18da7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:58.421064 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-fa3e0bb1-7b4d-4060-9924-beecb4f18da7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:58.427777 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-fa3e0bb1-7b4d-4060-9924-beecb4f18da7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1241 microversion: 2.1 time: 0.064954 Sep 13 01:22:58.428337 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 274/554] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:58 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:22:59.452472 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-62d340e9-8bda-46bd-97f4-480772afdf64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:22:59.453093 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-62d340e9-8bda-46bd-97f4-480772afdf64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:22:59.460017 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-62d340e9-8bda-46bd-97f4-480772afdf64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:59.460511 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-62d340e9-8bda-46bd-97f4-480772afdf64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:59.460947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-62d340e9-8bda-46bd-97f4-480772afdf64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:59.461642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-62d340e9-8bda-46bd-97f4-480772afdf64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:22:59.462097 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-62d340e9-8bda-46bd-97f4-480772afdf64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:22:59.462522 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-62d340e9-8bda-46bd-97f4-480772afdf64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:22:59.529466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-62d340e9-8bda-46bd-97f4-480772afdf64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:22:59.537444 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-62d340e9-8bda-46bd-97f4-480772afdf64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1293 microversion: 2.1 time: 0.090192 Sep 13 01:22:59.538037 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 281/555] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:22:59 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1293 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:00.560560 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8696c16d-5b4a-41ab-b740-abda949999a5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:00.561412 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-8696c16d-5b4a-41ab-b740-abda949999a5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:00.568342 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8696c16d-5b4a-41ab-b740-abda949999a5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:00.568929 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8696c16d-5b4a-41ab-b740-abda949999a5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:00.569421 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8696c16d-5b4a-41ab-b740-abda949999a5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:00.570190 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8696c16d-5b4a-41ab-b740-abda949999a5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:00.570745 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8696c16d-5b4a-41ab-b740-abda949999a5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:00.571446 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8696c16d-5b4a-41ab-b740-abda949999a5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:00.773438 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-8696c16d-5b4a-41ab-b740-abda949999a5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:00.781236 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-8696c16d-5b4a-41ab-b740-abda949999a5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1367 microversion: 2.1 time: 0.225034 Sep 13 01:23:00.781807 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 275/556] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:00 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:01.254424 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-3bcb7b03-8b11-469c-8ef7-d3596a94d39f req-b3fb3a74-1e75-4766-b354-23b1b5de85f2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4334e1fb-8fd8-47e4-a1dd-fb08c0b83480", "tag": "c89a2bf8-5d6d-499b-acf5-34318ae145ba"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:01.266772 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-3bcb7b03-8b11-469c-8ef7-d3596a94d39f req-b3fb3a74-1e75-4766-b354-23b1b5de85f2 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:01.267293 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-3bcb7b03-8b11-469c-8ef7-d3596a94d39f req-b3fb3a74-1e75-4766-b354-23b1b5de85f2 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:01.267726 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-3bcb7b03-8b11-469c-8ef7-d3596a94d39f req-b3fb3a74-1e75-4766-b354-23b1b5de85f2 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:01.280225 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-3bcb7b03-8b11-469c-8ef7-d3596a94d39f req-b3fb3a74-1e75-4766-b354-23b1b5de85f2 service nova] Creating event network-changed:c89a2bf8-5d6d-499b-acf5-34318ae145ba for instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 on hv-cinder-85694 Sep 13 01:23:01.284981 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-3bcb7b03-8b11-469c-8ef7-d3596a94d39f req-b3fb3a74-1e75-4766-b354-23b1b5de85f2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034556 Sep 13 01:23:01.285581 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 282/557] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:01.803972 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-07fbeb46-cf6d-408d-9ddf-ab6ddb2c7e25 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:01.804587 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-07fbeb46-cf6d-408d-9ddf-ab6ddb2c7e25 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:01.811704 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-07fbeb46-cf6d-408d-9ddf-ab6ddb2c7e25 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:01.812220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-07fbeb46-cf6d-408d-9ddf-ab6ddb2c7e25 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:01.812658 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-07fbeb46-cf6d-408d-9ddf-ab6ddb2c7e25 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:01.813383 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-07fbeb46-cf6d-408d-9ddf-ab6ddb2c7e25 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:01.813836 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-07fbeb46-cf6d-408d-9ddf-ab6ddb2c7e25 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:01.814320 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-07fbeb46-cf6d-408d-9ddf-ab6ddb2c7e25 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:01.942304 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-07fbeb46-cf6d-408d-9ddf-ab6ddb2c7e25 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:01.950386 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-07fbeb46-cf6d-408d-9ddf-ab6ddb2c7e25 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1367 microversion: 2.1 time: 0.149822 Sep 13 01:23:01.950985 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 276/558] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:01 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:02.974240 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0655b04c-598c-4755-a4d0-ba3217e1e94f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:02.974975 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0655b04c-598c-4755-a4d0-ba3217e1e94f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:02.981570 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0655b04c-598c-4755-a4d0-ba3217e1e94f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:02.982056 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0655b04c-598c-4755-a4d0-ba3217e1e94f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:02.982496 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0655b04c-598c-4755-a4d0-ba3217e1e94f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:02.983250 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0655b04c-598c-4755-a4d0-ba3217e1e94f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:02.983708 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0655b04c-598c-4755-a4d0-ba3217e1e94f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:02.984133 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0655b04c-598c-4755-a4d0-ba3217e1e94f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:03.114673 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0655b04c-598c-4755-a4d0-ba3217e1e94f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:03.122472 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0655b04c-598c-4755-a4d0-ba3217e1e94f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1367 microversion: 2.1 time: 0.152984 Sep 13 01:23:03.123067 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 283/559] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:02 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:03.581290 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7262a002-13b9-4dd6-a50d-e112e3132748 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:03.581780 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7262a002-13b9-4dd6-a50d-e112e3132748 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:03.588401 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7262a002-13b9-4dd6-a50d-e112e3132748 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:03.588886 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7262a002-13b9-4dd6-a50d-e112e3132748 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:03.589321 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7262a002-13b9-4dd6-a50d-e112e3132748 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:03.590014 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7262a002-13b9-4dd6-a50d-e112e3132748 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:03.591133 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7262a002-13b9-4dd6-a50d-e112e3132748 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:03.591622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7262a002-13b9-4dd6-a50d-e112e3132748 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:03.670074 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-7262a002-13b9-4dd6-a50d-e112e3132748 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lazy-loading 'services' on Instance uuid d89f56d9-6326-419a-ad10-fb520d83ec2a {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:23:03.745294 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7262a002-13b9-4dd6-a50d-e112e3132748 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-volume_attachments/b3b62c9f-35ac-458d-b4bd-495ceca4ca00" status: 202 len: 0 microversion: 2.1 time: 0.167861 Sep 13 01:23:03.745880 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 277/560] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 01:23:03 2022] DELETE /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-volume_attachments/b3b62c9f-35ac-458d-b4bd-495ceca4ca00 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:23:03.756523 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-20385a14-d0de-4bbc-8231-fae0a6e9e0c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:03.758701 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-20385a14-d0de-4bbc-8231-fae0a6e9e0c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:03.766592 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-20385a14-d0de-4bbc-8231-fae0a6e9e0c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:03.767406 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-20385a14-d0de-4bbc-8231-fae0a6e9e0c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:03.767926 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-20385a14-d0de-4bbc-8231-fae0a6e9e0c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:03.768717 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-20385a14-d0de-4bbc-8231-fae0a6e9e0c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:03.769201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-20385a14-d0de-4bbc-8231-fae0a6e9e0c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:03.769810 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-20385a14-d0de-4bbc-8231-fae0a6e9e0c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:03.805080 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-20385a14-d0de-4bbc-8231-fae0a6e9e0c9 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053530 Sep 13 01:23:03.805649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 284/561] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:23:03 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:04.145816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9cea52c5-13f6-497e-9a07-92b408e3e6ec tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:04.146514 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9cea52c5-13f6-497e-9a07-92b408e3e6ec tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:04.153645 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9cea52c5-13f6-497e-9a07-92b408e3e6ec tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:04.154128 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9cea52c5-13f6-497e-9a07-92b408e3e6ec tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:04.154563 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9cea52c5-13f6-497e-9a07-92b408e3e6ec tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:04.155294 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9cea52c5-13f6-497e-9a07-92b408e3e6ec tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:04.155838 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9cea52c5-13f6-497e-9a07-92b408e3e6ec tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:04.156310 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9cea52c5-13f6-497e-9a07-92b408e3e6ec tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:04.285657 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-9cea52c5-13f6-497e-9a07-92b408e3e6ec tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:04.293304 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9cea52c5-13f6-497e-9a07-92b408e3e6ec tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1367 microversion: 2.1 time: 0.151770 Sep 13 01:23:04.294594 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 278/562] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:04 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:04.819254 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1f6002e6-8715-4533-acff-80d27af86a9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:04.821453 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1f6002e6-8715-4533-acff-80d27af86a9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:04.827937 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f6002e6-8715-4533-acff-80d27af86a9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:04.828416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f6002e6-8715-4533-acff-80d27af86a9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:04.828847 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f6002e6-8715-4533-acff-80d27af86a9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:04.829605 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f6002e6-8715-4533-acff-80d27af86a9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:04.830055 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f6002e6-8715-4533-acff-80d27af86a9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:04.830472 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f6002e6-8715-4533-acff-80d27af86a9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:04.860072 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1f6002e6-8715-4533-acff-80d27af86a9d tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046015 Sep 13 01:23:04.860621 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 285/563] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:23:04 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 01:23:04.937871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-669ded96-cdd8-4d3f-8d03-a33d156195a6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:04.938404 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-669ded96-cdd8-4d3f-8d03-a33d156195a6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:04.944787 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-669ded96-cdd8-4d3f-8d03-a33d156195a6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:04.945263 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-669ded96-cdd8-4d3f-8d03-a33d156195a6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:04.945692 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-669ded96-cdd8-4d3f-8d03-a33d156195a6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:04.946371 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-669ded96-cdd8-4d3f-8d03-a33d156195a6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:04.946819 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-669ded96-cdd8-4d3f-8d03-a33d156195a6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:04.947262 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-669ded96-cdd8-4d3f-8d03-a33d156195a6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:04.972226 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-669ded96-cdd8-4d3f-8d03-a33d156195a6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Going to try to terminate instance {{(pid=120412) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:23:05.044058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-669ded96-cdd8-4d3f-8d03-a33d156195a6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "DELETE /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 204 len: 0 microversion: 2.1 time: 0.109328 Sep 13 01:23:05.045203 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 279/564] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:23:04 2022] DELETE /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:23:05.053233 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-10c9556e-8b60-43ea-ba0d-c7b05a6beafc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:05.053842 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-10c9556e-8b60-43ea-ba0d-c7b05a6beafc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:05.059991 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-10c9556e-8b60-43ea-ba0d-c7b05a6beafc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:05.060465 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-10c9556e-8b60-43ea-ba0d-c7b05a6beafc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:05.060897 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-10c9556e-8b60-43ea-ba0d-c7b05a6beafc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:05.061576 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-10c9556e-8b60-43ea-ba0d-c7b05a6beafc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:05.062021 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-10c9556e-8b60-43ea-ba0d-c7b05a6beafc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:05.062436 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-10c9556e-8b60-43ea-ba0d-c7b05a6beafc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:05.194426 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-10c9556e-8b60-43ea-ba0d-c7b05a6beafc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:05.202490 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-10c9556e-8b60-43ea-ba0d-c7b05a6beafc tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1688 microversion: 2.1 time: 0.153318 Sep 13 01:23:05.203093 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 286/565] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:05 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:05.317279 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-730b7f42-4f26-4744-9413-65bda3eff1ca tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:05.318011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-730b7f42-4f26-4744-9413-65bda3eff1ca tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:05.319913 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=2,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:05.326489 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-730b7f42-4f26-4744-9413-65bda3eff1ca tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:05.327014 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-730b7f42-4f26-4744-9413-65bda3eff1ca tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:05.327456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-730b7f42-4f26-4744-9413-65bda3eff1ca tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:05.328157 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-730b7f42-4f26-4744-9413-65bda3eff1ca tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:05.328607 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-730b7f42-4f26-4744-9413-65bda3eff1ca tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:05.329027 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-730b7f42-4f26-4744-9413-65bda3eff1ca tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:05.465383 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-730b7f42-4f26-4744-9413-65bda3eff1ca tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:05.472188 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-2416faec-2d47-4136-ac35-648d37149af4 req-c4c3384e-1652-40e4-ab38-b1056446214a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4334e1fb-8fd8-47e4-a1dd-fb08c0b83480", "name": "network-vif-plugged", "status": "completed", "tag": "c89a2bf8-5d6d-499b-acf5-34318ae145ba"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:05.474153 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-730b7f42-4f26-4744-9413-65bda3eff1ca tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1367 microversion: 2.1 time: 0.161144 Sep 13 01:23:05.474820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 280/566] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:05 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:05.483217 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2416faec-2d47-4136-ac35-648d37149af4 req-c4c3384e-1652-40e4-ab38-b1056446214a service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:05.483699 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2416faec-2d47-4136-ac35-648d37149af4 req-c4c3384e-1652-40e4-ab38-b1056446214a service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:05.484119 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2416faec-2d47-4136-ac35-648d37149af4 req-c4c3384e-1652-40e4-ab38-b1056446214a service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:05.495271 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-2416faec-2d47-4136-ac35-648d37149af4 req-c4c3384e-1652-40e4-ab38-b1056446214a service nova] Creating event network-vif-plugged:c89a2bf8-5d6d-499b-acf5-34318ae145ba for instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 on hv-cinder-85694 Sep 13 01:23:05.501294 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-2416faec-2d47-4136-ac35-648d37149af4 req-c4c3384e-1652-40e4-ab38-b1056446214a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032801 Sep 13 01:23:05.502308 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 287/567] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:23:06.225846 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-52f87b09-09fa-432c-9106-c86b79d4cf3a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:06.226464 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-52f87b09-09fa-432c-9106-c86b79d4cf3a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:06.232802 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-52f87b09-09fa-432c-9106-c86b79d4cf3a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:06.233900 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-52f87b09-09fa-432c-9106-c86b79d4cf3a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:06.234348 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-52f87b09-09fa-432c-9106-c86b79d4cf3a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:06.235073 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-52f87b09-09fa-432c-9106-c86b79d4cf3a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:06.235528 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-52f87b09-09fa-432c-9106-c86b79d4cf3a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:06.235954 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-52f87b09-09fa-432c-9106-c86b79d4cf3a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:06.368375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-52f87b09-09fa-432c-9106-c86b79d4cf3a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:06.376777 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-52f87b09-09fa-432c-9106-c86b79d4cf3a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1688 microversion: 2.1 time: 0.154708 Sep 13 01:23:06.377350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 281/568] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:06 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:06.499254 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-08a59c04-7c39-47c5-92e2-6611d07a355b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:06.499961 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-08a59c04-7c39-47c5-92e2-6611d07a355b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:06.506136 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-08a59c04-7c39-47c5-92e2-6611d07a355b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:06.506622 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-08a59c04-7c39-47c5-92e2-6611d07a355b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:06.507100 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-08a59c04-7c39-47c5-92e2-6611d07a355b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:06.507791 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-08a59c04-7c39-47c5-92e2-6611d07a355b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:06.508245 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-08a59c04-7c39-47c5-92e2-6611d07a355b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:06.508670 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-08a59c04-7c39-47c5-92e2-6611d07a355b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:06.634807 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-08a59c04-7c39-47c5-92e2-6611d07a355b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:06.642474 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-08a59c04-7c39-47c5-92e2-6611d07a355b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1367 microversion: 2.1 time: 0.148683 Sep 13 01:23:06.643164 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 288/569] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:06 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:07.399706 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-17475662-ce6b-4353-8aac-4ce927de5822 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:07.400311 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-17475662-ce6b-4353-8aac-4ce927de5822 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:07.407410 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-17475662-ce6b-4353-8aac-4ce927de5822 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:07.407901 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-17475662-ce6b-4353-8aac-4ce927de5822 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:07.408373 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-17475662-ce6b-4353-8aac-4ce927de5822 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:07.409070 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-17475662-ce6b-4353-8aac-4ce927de5822 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:07.409524 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-17475662-ce6b-4353-8aac-4ce927de5822 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:07.409970 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-17475662-ce6b-4353-8aac-4ce927de5822 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:07.540532 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-17475662-ce6b-4353-8aac-4ce927de5822 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:07.548237 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-17475662-ce6b-4353-8aac-4ce927de5822 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1688 microversion: 2.1 time: 0.152370 Sep 13 01:23:07.548992 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 282/570] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:07 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1688 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:07.665090 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-25da4241-4014-4fe7-ae58-6f4be1aefdc6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:07.665628 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-25da4241-4014-4fe7-ae58-6f4be1aefdc6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:07.672002 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25da4241-4014-4fe7-ae58-6f4be1aefdc6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:07.672481 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25da4241-4014-4fe7-ae58-6f4be1aefdc6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:07.672915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25da4241-4014-4fe7-ae58-6f4be1aefdc6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:07.673604 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25da4241-4014-4fe7-ae58-6f4be1aefdc6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:07.674062 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25da4241-4014-4fe7-ae58-6f4be1aefdc6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:07.674483 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-25da4241-4014-4fe7-ae58-6f4be1aefdc6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:07.801129 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-25da4241-4014-4fe7-ae58-6f4be1aefdc6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:07.809530 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-25da4241-4014-4fe7-ae58-6f4be1aefdc6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1367 microversion: 2.1 time: 0.147878 Sep 13 01:23:07.810126 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 289/571] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:07 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:08.571733 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d3635b25-af9b-4a18-9749-036073eae0e0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:08.572346 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d3635b25-af9b-4a18-9749-036073eae0e0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:08.574609 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=6 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:08.580119 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d3635b25-af9b-4a18-9749-036073eae0e0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:08.580600 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d3635b25-af9b-4a18-9749-036073eae0e0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:08.581034 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d3635b25-af9b-4a18-9749-036073eae0e0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:08.581720 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d3635b25-af9b-4a18-9749-036073eae0e0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:08.582173 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d3635b25-af9b-4a18-9749-036073eae0e0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:08.582626 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d3635b25-af9b-4a18-9749-036073eae0e0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:08.712533 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d3635b25-af9b-4a18-9749-036073eae0e0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:08.721515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d3635b25-af9b-4a18-9749-036073eae0e0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1688 microversion: 2.1 time: 0.153527 Sep 13 01:23:08.722116 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 283/572] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:08 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:08.832040 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3b54b3ee-e68a-437e-bdd5-7759c677f00d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:08.832655 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3b54b3ee-e68a-437e-bdd5-7759c677f00d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:08.834801 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:08.835622 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=6 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:08.842296 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b54b3ee-e68a-437e-bdd5-7759c677f00d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:08.842785 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b54b3ee-e68a-437e-bdd5-7759c677f00d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:08.843266 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b54b3ee-e68a-437e-bdd5-7759c677f00d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:08.843974 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b54b3ee-e68a-437e-bdd5-7759c677f00d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:08.844429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b54b3ee-e68a-437e-bdd5-7759c677f00d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:08.844856 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3b54b3ee-e68a-437e-bdd5-7759c677f00d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:08.973920 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3b54b3ee-e68a-437e-bdd5-7759c677f00d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:08.982165 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3b54b3ee-e68a-437e-bdd5-7759c677f00d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1367 microversion: 2.1 time: 0.153916 Sep 13 01:23:08.983014 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 290/573] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:08 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:09.745299 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7168bb5e-fe79-4443-b295-dbcc50c13d9f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:09.745975 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7168bb5e-fe79-4443-b295-dbcc50c13d9f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:09.752859 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7168bb5e-fe79-4443-b295-dbcc50c13d9f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:09.753349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7168bb5e-fe79-4443-b295-dbcc50c13d9f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:09.753819 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7168bb5e-fe79-4443-b295-dbcc50c13d9f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:09.754700 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7168bb5e-fe79-4443-b295-dbcc50c13d9f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:09.755181 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7168bb5e-fe79-4443-b295-dbcc50c13d9f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:09.755606 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7168bb5e-fe79-4443-b295-dbcc50c13d9f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:09.841954 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7168bb5e-fe79-4443-b295-dbcc50c13d9f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:09.844145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:09.850924 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7168bb5e-fe79-4443-b295-dbcc50c13d9f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1620 microversion: 2.1 time: 0.109526 Sep 13 01:23:09.851506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 284/574] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:09 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1620 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:09.948795 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-2a70139c-3ca0-4643-92b3-155dea266bd9 req-ee478c3d-8610-4003-b288-eb5687625d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d89f56d9-6326-419a-ad10-fb520d83ec2a", "name": "network-vif-deleted", "tag": "d4354f6f-2db0-4d03-a3d4-4ddab59e9460"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:09.959804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2a70139c-3ca0-4643-92b3-155dea266bd9 req-ee478c3d-8610-4003-b288-eb5687625d54 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:09.960282 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2a70139c-3ca0-4643-92b3-155dea266bd9 req-ee478c3d-8610-4003-b288-eb5687625d54 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:09.960744 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-2a70139c-3ca0-4643-92b3-155dea266bd9 req-ee478c3d-8610-4003-b288-eb5687625d54 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:09.973000 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-2a70139c-3ca0-4643-92b3-155dea266bd9 req-ee478c3d-8610-4003-b288-eb5687625d54 service nova] Creating event network-vif-deleted:d4354f6f-2db0-4d03-a3d4-4ddab59e9460 for instance d89f56d9-6326-419a-ad10-fb520d83ec2a on hv-cinder-85694 Sep 13 01:23:09.977980 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-2a70139c-3ca0-4643-92b3-155dea266bd9 req-ee478c3d-8610-4003-b288-eb5687625d54 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032961 Sep 13 01:23:09.979102 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 291/575] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:10.005180 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1992b8bf-74b6-4782-bb50-7fe94f6c808d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:10.005810 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1992b8bf-74b6-4782-bb50-7fe94f6c808d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:10.013473 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1992b8bf-74b6-4782-bb50-7fe94f6c808d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:10.014107 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1992b8bf-74b6-4782-bb50-7fe94f6c808d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:10.014643 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1992b8bf-74b6-4782-bb50-7fe94f6c808d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:10.015511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1992b8bf-74b6-4782-bb50-7fe94f6c808d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:10.016185 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1992b8bf-74b6-4782-bb50-7fe94f6c808d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:10.016711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1992b8bf-74b6-4782-bb50-7fe94f6c808d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:10.182373 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1992b8bf-74b6-4782-bb50-7fe94f6c808d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:10.190792 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1992b8bf-74b6-4782-bb50-7fe94f6c808d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1367 microversion: 2.1 time: 0.189535 Sep 13 01:23:10.191641 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 285/576] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:10 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:10.535590 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4c3e5172-eec3-4eac-a4b1-f3252cd980b8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:10.537907 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4c3e5172-eec3-4eac-a4b1-f3252cd980b8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:10.544907 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c3e5172-eec3-4eac-a4b1-f3252cd980b8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:10.545506 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c3e5172-eec3-4eac-a4b1-f3252cd980b8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:10.546015 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c3e5172-eec3-4eac-a4b1-f3252cd980b8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:10.546799 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c3e5172-eec3-4eac-a4b1-f3252cd980b8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:10.547344 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c3e5172-eec3-4eac-a4b1-f3252cd980b8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:10.547882 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c3e5172-eec3-4eac-a4b1-f3252cd980b8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:10.580792 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4c3e5172-eec3-4eac-a4b1-f3252cd980b8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049438 Sep 13 01:23:10.581473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 292/577] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:23:10 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 01:23:10.645190 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0321a43b-6634-4855-8864-12f1307fa9e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:10.645692 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0321a43b-6634-4855-8864-12f1307fa9e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:10.652263 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0321a43b-6634-4855-8864-12f1307fa9e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:10.653327 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0321a43b-6634-4855-8864-12f1307fa9e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:10.653741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0321a43b-6634-4855-8864-12f1307fa9e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:10.654542 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0321a43b-6634-4855-8864-12f1307fa9e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:10.655049 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0321a43b-6634-4855-8864-12f1307fa9e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:10.655478 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0321a43b-6634-4855-8864-12f1307fa9e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:10.684500 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0321a43b-6634-4855-8864-12f1307fa9e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Going to try to terminate instance {{(pid=120412) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:23:10.783588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0321a43b-6634-4855-8864-12f1307fa9e5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "DELETE /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 204 len: 0 microversion: 2.1 time: 0.141372 Sep 13 01:23:10.784664 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 286/578] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:23:10 2022] DELETE /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:23:10.792938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9f777629-df30-4912-9eed-d31981facd1b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:10.794270 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9f777629-df30-4912-9eed-d31981facd1b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:10.800285 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9f777629-df30-4912-9eed-d31981facd1b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:10.800770 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9f777629-df30-4912-9eed-d31981facd1b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:10.801205 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9f777629-df30-4912-9eed-d31981facd1b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:10.801899 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9f777629-df30-4912-9eed-d31981facd1b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:10.802525 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9f777629-df30-4912-9eed-d31981facd1b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:10.802976 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9f777629-df30-4912-9eed-d31981facd1b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:10.874161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:10.875488 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:10.882748 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:10.883338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:10.884003 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:10.884948 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:10.885910 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:10.885910 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:10.922329 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:10.922821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:10.923286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:10.923993 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lazy-loading 'fault' on Instance uuid d89f56d9-6326-419a-ad10-fb520d83ec2a {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:23:10.940553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9f777629-df30-4912-9eed-d31981facd1b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:10.948572 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9f777629-df30-4912-9eed-d31981facd1b tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1671 microversion: 2.1 time: 0.159461 Sep 13 01:23:10.949143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 293/579] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:10 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1671 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:10.966466 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:10.974047 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a63c836c-42c3-45fa-8758-db18376dd711 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1335 microversion: 2.1 time: 0.104228 Sep 13 01:23:10.974618 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 287/580] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:10 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1335 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:11.213407 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d2d82900-093c-48cf-952b-b1d1b77a5cf9 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:11.213927 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d2d82900-093c-48cf-952b-b1d1b77a5cf9 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:11.221050 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d2d82900-093c-48cf-952b-b1d1b77a5cf9 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:11.221530 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d2d82900-093c-48cf-952b-b1d1b77a5cf9 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:11.221961 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d2d82900-093c-48cf-952b-b1d1b77a5cf9 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:11.222653 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d2d82900-093c-48cf-952b-b1d1b77a5cf9 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:11.223123 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d2d82900-093c-48cf-952b-b1d1b77a5cf9 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:11.223538 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d2d82900-093c-48cf-952b-b1d1b77a5cf9 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:11.354765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d2d82900-093c-48cf-952b-b1d1b77a5cf9 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:11.362827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d2d82900-093c-48cf-952b-b1d1b77a5cf9 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1557 microversion: 2.1 time: 0.153366 Sep 13 01:23:11.363415 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 294/581] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:11 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:11.385304 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5f3e1d61-51af-4d2a-b956-fc3f1c815689 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:11.385808 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-5f3e1d61-51af-4d2a-b956-fc3f1c815689 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:11.392434 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5f3e1d61-51af-4d2a-b956-fc3f1c815689 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:11.392915 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5f3e1d61-51af-4d2a-b956-fc3f1c815689 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:11.393351 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5f3e1d61-51af-4d2a-b956-fc3f1c815689 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:11.394046 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5f3e1d61-51af-4d2a-b956-fc3f1c815689 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:11.394499 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5f3e1d61-51af-4d2a-b956-fc3f1c815689 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:11.394948 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5f3e1d61-51af-4d2a-b956-fc3f1c815689 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:11.469229 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-5f3e1d61-51af-4d2a-b956-fc3f1c815689 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087759 Sep 13 01:23:11.469822 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 288/582] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 01:23:11 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:11.971748 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e5a48820-112f-4a61-87c1-6fd04039e2b9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:11.972401 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e5a48820-112f-4a61-87c1-6fd04039e2b9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:11.978267 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e5a48820-112f-4a61-87c1-6fd04039e2b9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:11.978754 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e5a48820-112f-4a61-87c1-6fd04039e2b9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:11.979222 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e5a48820-112f-4a61-87c1-6fd04039e2b9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:11.979915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e5a48820-112f-4a61-87c1-6fd04039e2b9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:11.980371 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e5a48820-112f-4a61-87c1-6fd04039e2b9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:11.981315 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e5a48820-112f-4a61-87c1-6fd04039e2b9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:11.996433 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:11.997603 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:12.004371 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:12.004856 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:12.005292 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:12.005990 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:12.006444 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:12.007013 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:12.041075 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:12.041566 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:12.042197 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:12.042665 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lazy-loading 'fault' on Instance uuid d89f56d9-6326-419a-ad10-fb520d83ec2a {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:23:12.116049 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e5a48820-112f-4a61-87c1-6fd04039e2b9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:12.124154 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e5a48820-112f-4a61-87c1-6fd04039e2b9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1671 microversion: 2.1 time: 0.156150 Sep 13 01:23:12.124746 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 295/583] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:11 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1671 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:12.325656 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:12.333252 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-985591eb-1b48-4b16-9ccd-7040f9fedbd8 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1335 microversion: 2.1 time: 0.340737 Sep 13 01:23:12.333834 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 289/584] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:11 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1335 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:12.428298 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f61d0610-8ab2-4a68-96be-a7db6361794d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:12.428862 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f61d0610-8ab2-4a68-96be-a7db6361794d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:12.435480 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f61d0610-8ab2-4a68-96be-a7db6361794d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:12.436020 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f61d0610-8ab2-4a68-96be-a7db6361794d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:12.436490 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f61d0610-8ab2-4a68-96be-a7db6361794d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:12.437189 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f61d0610-8ab2-4a68-96be-a7db6361794d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:12.437647 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f61d0610-8ab2-4a68-96be-a7db6361794d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:12.438076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f61d0610-8ab2-4a68-96be-a7db6361794d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:12.452535 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:12.462341 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-f61d0610-8ab2-4a68-96be-a7db6361794d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lazy-loading 'flavor' on Instance uuid cf5279a7-4859-458b-958c-85fd71cb4d72 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:23:12.535088 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f61d0610-8ab2-4a68-96be-a7db6361794d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "POST /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72/action" status: 202 len: 0 microversion: 2.1 time: 0.110459 Sep 13 01:23:12.535755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 296/585] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:23:12 2022] POST /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:23:12.544171 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-791bbddf-8d62-48eb-970d-ce1bd95d5d6b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:12.545092 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-791bbddf-8d62-48eb-970d-ce1bd95d5d6b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:12.551202 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-791bbddf-8d62-48eb-970d-ce1bd95d5d6b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:12.551692 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-791bbddf-8d62-48eb-970d-ce1bd95d5d6b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:12.552130 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-791bbddf-8d62-48eb-970d-ce1bd95d5d6b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:12.552833 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-791bbddf-8d62-48eb-970d-ce1bd95d5d6b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:12.553293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-791bbddf-8d62-48eb-970d-ce1bd95d5d6b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:12.553716 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-791bbddf-8d62-48eb-970d-ce1bd95d5d6b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:12.705104 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-45dacbcd-c0c3-4c64-95a2-c6436a87a097 req-6bc6ec02-493e-4134-8dbb-d94175f5bf6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4334e1fb-8fd8-47e4-a1dd-fb08c0b83480", "tag": "c89a2bf8-5d6d-499b-acf5-34318ae145ba"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:12.714598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-45dacbcd-c0c3-4c64-95a2-c6436a87a097 req-6bc6ec02-493e-4134-8dbb-d94175f5bf6b service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:12.715292 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-45dacbcd-c0c3-4c64-95a2-c6436a87a097 req-6bc6ec02-493e-4134-8dbb-d94175f5bf6b service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:12.716526 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-45dacbcd-c0c3-4c64-95a2-c6436a87a097 req-6bc6ec02-493e-4134-8dbb-d94175f5bf6b service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:12.729913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-45dacbcd-c0c3-4c64-95a2-c6436a87a097 req-6bc6ec02-493e-4134-8dbb-d94175f5bf6b service nova] Creating event network-changed:c89a2bf8-5d6d-499b-acf5-34318ae145ba for instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 on hv-cinder-85694 Sep 13 01:23:12.736708 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-45dacbcd-c0c3-4c64-95a2-c6436a87a097 req-6bc6ec02-493e-4134-8dbb-d94175f5bf6b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035410 Sep 13 01:23:12.738069 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 297/586] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:23:12.749855 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-791bbddf-8d62-48eb-970d-ce1bd95d5d6b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:12.757726 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-791bbddf-8d62-48eb-970d-ce1bd95d5d6b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.217528 Sep 13 01:23:12.758389 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 290/587] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:12 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:13.147832 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5adc3ca2-27f1-4e43-9516-0e0c2ea6c611 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:13.148681 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5adc3ca2-27f1-4e43-9516-0e0c2ea6c611 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:13.155324 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5adc3ca2-27f1-4e43-9516-0e0c2ea6c611 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:13.155839 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5adc3ca2-27f1-4e43-9516-0e0c2ea6c611 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:13.156277 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5adc3ca2-27f1-4e43-9516-0e0c2ea6c611 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:13.156972 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5adc3ca2-27f1-4e43-9516-0e0c2ea6c611 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:13.157422 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5adc3ca2-27f1-4e43-9516-0e0c2ea6c611 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:13.157840 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5adc3ca2-27f1-4e43-9516-0e0c2ea6c611 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:13.303608 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5adc3ca2-27f1-4e43-9516-0e0c2ea6c611 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:13.312869 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5adc3ca2-27f1-4e43-9516-0e0c2ea6c611 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1671 microversion: 2.1 time: 0.169136 Sep 13 01:23:13.313663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 298/588] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:13 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1671 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:13.363639 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:13.364840 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:13.384619 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:13.385162 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:13.385661 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:13.388204 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:13.388862 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:13.389638 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:13.439310 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:13.440144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:13.440743 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:13.441377 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lazy-loading 'fault' on Instance uuid d89f56d9-6326-419a-ad10-fb520d83ec2a {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:23:13.537535 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:13.547127 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0f75c330-2515-4e97-b56d-17fe7317065c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 200 len: 1335 microversion: 2.1 time: 0.194369 Sep 13 01:23:13.547984 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 291/589] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:13 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 1335 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:13.781677 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-161fdfb5-dd8f-4bde-b541-20c7c8f86ef2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:13.782282 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-161fdfb5-dd8f-4bde-b541-20c7c8f86ef2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:13.788631 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-161fdfb5-dd8f-4bde-b541-20c7c8f86ef2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:13.789173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-161fdfb5-dd8f-4bde-b541-20c7c8f86ef2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:13.789609 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-161fdfb5-dd8f-4bde-b541-20c7c8f86ef2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:13.790296 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-161fdfb5-dd8f-4bde-b541-20c7c8f86ef2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:13.790743 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-161fdfb5-dd8f-4bde-b541-20c7c8f86ef2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:13.791182 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-161fdfb5-dd8f-4bde-b541-20c7c8f86ef2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:13.926671 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-161fdfb5-dd8f-4bde-b541-20c7c8f86ef2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:13.934876 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-161fdfb5-dd8f-4bde-b541-20c7c8f86ef2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.157204 Sep 13 01:23:13.935451 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 299/590] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:13 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:14.336467 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-fd09f1f1-7fce-4e1f-a64e-fba6094556ba tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:14.337296 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-fd09f1f1-7fce-4e1f-a64e-fba6094556ba tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:14.343651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd09f1f1-7fce-4e1f-a64e-fba6094556ba tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:14.344218 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd09f1f1-7fce-4e1f-a64e-fba6094556ba tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:14.344872 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd09f1f1-7fce-4e1f-a64e-fba6094556ba tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:14.345649 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd09f1f1-7fce-4e1f-a64e-fba6094556ba tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:14.346175 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd09f1f1-7fce-4e1f-a64e-fba6094556ba tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:14.346669 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fd09f1f1-7fce-4e1f-a64e-fba6094556ba tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:14.415575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-fd09f1f1-7fce-4e1f-a64e-fba6094556ba tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:14.425864 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-fd09f1f1-7fce-4e1f-a64e-fba6094556ba tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 200 len: 1603 microversion: 2.1 time: 0.093208 Sep 13 01:23:14.426457 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 292/591] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:14 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 1603 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:14.573958 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7ca3068b-4ce4-4b5b-97f2-9f1f1f689ae1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:14.575219 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7ca3068b-4ce4-4b5b-97f2-9f1f1f689ae1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: d89f56d9-6326-419a-ad10-fb520d83ec2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:14.581481 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca3068b-4ce4-4b5b-97f2-9f1f1f689ae1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:14.581973 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca3068b-4ce4-4b5b-97f2-9f1f1f689ae1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:14.582422 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca3068b-4ce4-4b5b-97f2-9f1f1f689ae1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:14.583168 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca3068b-4ce4-4b5b-97f2-9f1f1f689ae1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:14.583623 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca3068b-4ce4-4b5b-97f2-9f1f1f689ae1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:14.584354 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca3068b-4ce4-4b5b-97f2-9f1f1f689ae1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:14.612470 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-7ca3068b-4ce4-4b5b-97f2-9f1f1f689ae1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] HTTP exception thrown: Instance d89f56d9-6326-419a-ad10-fb520d83ec2a could not be found. Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7ca3068b-4ce4-4b5b-97f2-9f1f1f689ae1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Request method failure captured: Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a HTTP/1.1 Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9p4yMnrVK5GewsWLbTcRAz16uSc9TtrMuEljQX8sg0PXiBEAwAlB55augWK15AhNuOWCJg7_s89STcx-xwzZQh-CvS_k-5n7S0zKWbadfn4euhiUxAhZtEB4z7zlDtF2ivu7J04PPQiqOpRhilIzjzrHVHn7cC4gXETDbD4QP7c8NI Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: a84dd36fe9484f41bc2f0d7da4e47c13 Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:23:14.614827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:23:14.616601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a84dd36fe9484f41bc2f0d7da4e47c13"}]}] Sep 13 01:23:14.616601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:23:14.616601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: a84dd36fe9484f41bc2f0d7da4e47c13 Sep 13 01:23:14.616601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:23:14.616601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-ServerRescueNegativeTestJSON-293179200-project Sep 13 01:23:14.616601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:23:14.616601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:23:14.616601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 0c5dcfa5794843a5896fa051a4554e1f Sep 13 01:23:14.616601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-ServerRescueNegativeTestJSON-293179200-project Sep 13 01:23:14.616601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:23:14.616601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance d89f56d9-6326-419a-ad10-fb520d83ec2a could not be found. Sep 13 01:23:14.616601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': 'd89f56d9-6326-419a-ad10-fb520d83ec2a'} Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d89f56d9-6326-419a-ad10-fb520d83ec2a could not be found. Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:23:14.617614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d89f56d9-6326-419a-ad10-fb520d83ec2a could not be found. Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d89f56d9-6326-419a-ad10-fb520d83ec2a could not be found. Sep 13 01:23:14.619011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:14.623052 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7ca3068b-4ce4-4b5b-97f2-9f1f1f689ae1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Returning 404 to user: Instance d89f56d9-6326-419a-ad10-fb520d83ec2a could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:23:14.624301 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7ca3068b-4ce4-4b5b-97f2-9f1f1f689ae1 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a" status: 404 len: 111 microversion: 2.1 time: 0.054479 Sep 13 01:23:14.624801 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 300/592] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:14 2022] GET /compute/v2.1/servers/d89f56d9-6326-419a-ad10-fb520d83ec2a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 01:23:14.633393 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a6817ca6-773c-4247-981c-5a525590fb4a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '.version_select at 0x7fb05e433dc0>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:14.656118 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a6817ca6-773c-4247-981c-5a525590fb4a tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131583893" status: 202 len: 0 microversion: 2.1 time: 0.026825 Sep 13 01:23:14.660245 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 293/593] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Sep 13 01:23:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2131583893 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:23:14.756107 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-8db6c78e-9092-418a-9da6-9e8d409c831d req-5da12a3e-f258-4456-8571-3e47f4cc237a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "85de1ecb-9d12-49d4-b0cd-4631e36357d3", "name": "network-vif-deleted", "tag": "fd07ce18-daad-47e8-8e34-3a96d4e32e60"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:14.767755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-8db6c78e-9092-418a-9da6-9e8d409c831d req-5da12a3e-f258-4456-8571-3e47f4cc237a service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:14.768229 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-8db6c78e-9092-418a-9da6-9e8d409c831d req-5da12a3e-f258-4456-8571-3e47f4cc237a service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:14.768654 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-8db6c78e-9092-418a-9da6-9e8d409c831d req-5da12a3e-f258-4456-8571-3e47f4cc237a service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:14.779585 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-8db6c78e-9092-418a-9da6-9e8d409c831d req-5da12a3e-f258-4456-8571-3e47f4cc237a service nova] Creating event network-vif-deleted:fd07ce18-daad-47e8-8e34-3a96d4e32e60 for instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 on hv-cinder-85694 Sep 13 01:23:14.784520 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-8db6c78e-9092-418a-9da6-9e8d409c831d req-5da12a3e-f258-4456-8571-3e47f4cc237a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032632 Sep 13 01:23:14.785422 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 301/594] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:14.959240 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1aa7505a-60f1-4846-8aca-c441de2fcd91 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:14.960136 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1aa7505a-60f1-4846-8aca-c441de2fcd91 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:14.967923 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1aa7505a-60f1-4846-8aca-c441de2fcd91 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:14.968649 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1aa7505a-60f1-4846-8aca-c441de2fcd91 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:14.969255 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1aa7505a-60f1-4846-8aca-c441de2fcd91 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:14.970107 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1aa7505a-60f1-4846-8aca-c441de2fcd91 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:14.970708 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1aa7505a-60f1-4846-8aca-c441de2fcd91 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:14.971301 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1aa7505a-60f1-4846-8aca-c441de2fcd91 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:15.137851 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1aa7505a-60f1-4846-8aca-c441de2fcd91 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:15.146330 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1aa7505a-60f1-4846-8aca-c441de2fcd91 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.191066 Sep 13 01:23:15.147086 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 294/595] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:14 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:15.452205 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0ad96b40-b5b1-4df8-8205-d941b9f296a2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:15.452905 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0ad96b40-b5b1-4df8-8205-d941b9f296a2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:15.459530 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ad96b40-b5b1-4df8-8205-d941b9f296a2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:15.460008 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ad96b40-b5b1-4df8-8205-d941b9f296a2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:15.460434 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ad96b40-b5b1-4df8-8205-d941b9f296a2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:15.461112 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ad96b40-b5b1-4df8-8205-d941b9f296a2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:15.461559 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ad96b40-b5b1-4df8-8205-d941b9f296a2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:15.461972 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0ad96b40-b5b1-4df8-8205-d941b9f296a2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:15.475249 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-0ad96b40-b5b1-4df8-8205-d941b9f296a2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] HTTP exception thrown: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0ad96b40-b5b1-4df8-8205-d941b9f296a2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Request method failure captured: Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 HTTP/1.1 Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9pvh40nDQ7g0KDNIPvORUr0smXyn_a8EcB09L9t5ZYs6h-by3z3aSE_AXGz83-pX54TofZ_8CuYUqOd_8qmFVtD1HGtEnI5HWK64ftQV48tZn2FZS5hRN0kjchMampfCqgFfxC1_gQRj4ZU7LWcd_C_bolEfAWAV4ntXABiEUjE_44 Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 9056ec686513412a87c292387e25e870 Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:23:15.476809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:23:15.478299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9056ec686513412a87c292387e25e870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9056ec686513412a87c292387e25e870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9056ec686513412a87c292387e25e870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9056ec686513412a87c292387e25e870"}]}] Sep 13 01:23:15.478299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:23:15.478299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 9056ec686513412a87c292387e25e870 Sep 13 01:23:15.478299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:23:15.478299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeTestJSON-1146747367-project Sep 13 01:23:15.478299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:23:15.478299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:23:15.478299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 349e19300f1e48c3ac44fc34611c7f4a Sep 13 01:23:15.478299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeTestJSON-1146747367-project Sep 13 01:23:15.478299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:23:15.478299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:23:15.478299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '85de1ecb-9d12-49d4-b0cd-4631e36357d3'} Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:23:15.479155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:23:15.480519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:15.481788 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0ad96b40-b5b1-4df8-8205-d941b9f296a2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Returning 404 to user: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:23:15.481788 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0ad96b40-b5b1-4df8-8205-d941b9f296a2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 404 len: 111 microversion: 2.1 time: 0.031070 Sep 13 01:23:15.481788 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 302/596] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:15 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:23:15.488722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-dd69165d-586a-4919-9f74-90a00ddbb8a7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '.version_select at 0x7fb05e3f5700>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:15.508383 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-dd69165d-586a-4919-9f74-90a00ddbb8a7 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-553207030" status: 202 len: 0 microversion: 2.1 time: 0.024441 Sep 13 01:23:15.508968 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 295/597] 10.222.0.15 () {58 vars in 1218 bytes} [Tue Sep 13 01:23:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-553207030 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:23:16.082446 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bbfbc3bb-d429-486c-8426-74ee2cc1b815 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Action: 'create', calling method: .version_select at 0x7fb05f8b8dc0>, body: {"keypair": {"name": "tempest-keypair-1362496119", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBoLYiMbgng7gC7xnAbSAJ+bRMSBc0HI9D1+673KpDVNbbqNXVxpZo3BoLtUyMENcALqqyMQWnjq1y5v+40Phmo5d3mH2oNcl3uUorWJAzXBMy6RiVDqCD6GyV52K19KVg=="}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:16.097483 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-bbfbc3bb-d429-486c-8426-74ee2cc1b815 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Getting quotas for project 9056ec686513412a87c292387e25e870. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:23:16.101336 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-bbfbc3bb-d429-486c-8426-74ee2cc1b815 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Getting quotas for user 349e19300f1e48c3ac44fc34611c7f4a and project 9056ec686513412a87c292387e25e870. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:23:16.123435 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bbfbc3bb-d429-486c-8426-74ee2cc1b815 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044733 Sep 13 01:23:16.123957 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 303/598] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 01:23:16 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:16.171075 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-bfe8d3a9-dd17-43f4-8ec1-978c3f4d6120 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:16.171783 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-bfe8d3a9-dd17-43f4-8ec1-978c3f4d6120 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:16.177834 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfe8d3a9-dd17-43f4-8ec1-978c3f4d6120 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:16.178404 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfe8d3a9-dd17-43f4-8ec1-978c3f4d6120 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:16.178913 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfe8d3a9-dd17-43f4-8ec1-978c3f4d6120 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:16.179605 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfe8d3a9-dd17-43f4-8ec1-978c3f4d6120 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:16.180085 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfe8d3a9-dd17-43f4-8ec1-978c3f4d6120 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:16.180500 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfe8d3a9-dd17-43f4-8ec1-978c3f4d6120 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:16.360348 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-bfe8d3a9-dd17-43f4-8ec1-978c3f4d6120 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:16.368109 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-bfe8d3a9-dd17-43f4-8ec1-978c3f4d6120 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.201518 Sep 13 01:23:16.368683 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 296/599] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:16 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:17.392497 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fa93484f-72ea-415a-a51f-32126f039e90 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:17.393206 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fa93484f-72ea-415a-a51f-32126f039e90 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:17.400537 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fa93484f-72ea-415a-a51f-32126f039e90 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:17.401016 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fa93484f-72ea-415a-a51f-32126f039e90 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:17.401444 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fa93484f-72ea-415a-a51f-32126f039e90 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:17.402146 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fa93484f-72ea-415a-a51f-32126f039e90 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:17.402618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fa93484f-72ea-415a-a51f-32126f039e90 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:17.403086 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fa93484f-72ea-415a-a51f-32126f039e90 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:17.607272 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-60618513-6983-46dd-9f0f-d19781204766 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:17.607806 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-60618513-6983-46dd-9f0f-d19781204766 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:17.614325 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-60618513-6983-46dd-9f0f-d19781204766 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:17.614810 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-60618513-6983-46dd-9f0f-d19781204766 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:17.615286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-60618513-6983-46dd-9f0f-d19781204766 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:17.616058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-60618513-6983-46dd-9f0f-d19781204766 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:17.616514 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-60618513-6983-46dd-9f0f-d19781204766 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:17.617122 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-60618513-6983-46dd-9f0f-d19781204766 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:17.643785 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-60618513-6983-46dd-9f0f-d19781204766 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Going to try to terminate instance {{(pid=120412) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:23:17.656124 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fa93484f-72ea-415a-a51f-32126f039e90 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:17.656124 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fa93484f-72ea-415a-a51f-32126f039e90 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.266380 Sep 13 01:23:17.673784 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 304/600] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:17 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:17.732441 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-60618513-6983-46dd-9f0f-d19781204766 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "DELETE /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 204 len: 0 microversion: 2.1 time: 0.128269 Sep 13 01:23:17.736358 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 297/601] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:23:17 2022] DELETE /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 01:23:17.742344 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-72dd5c56-e87d-4ad9-bccc-733f0ddd2ad4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:17.743142 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-72dd5c56-e87d-4ad9-bccc-733f0ddd2ad4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:17.750806 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-215297369", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bdb1d525-4a86-4d73-99d0-0254f6253a0a"}], "security_groups": [{"name": "tempest-securitygroup--682709078"}], "key_name": "tempest-keypair-1362496119", "user_data": "}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:17.751651 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-72dd5c56-e87d-4ad9-bccc-733f0ddd2ad4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:17.752189 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-72dd5c56-e87d-4ad9-bccc-733f0ddd2ad4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:17.752627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-72dd5c56-e87d-4ad9-bccc-733f0ddd2ad4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:17.753331 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-72dd5c56-e87d-4ad9-bccc-733f0ddd2ad4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:17.753787 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-72dd5c56-e87d-4ad9-bccc-733f0ddd2ad4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:17.754211 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-72dd5c56-e87d-4ad9-bccc-733f0ddd2ad4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:17.854065 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.network.neutron [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] validate_networks() for [('bdb1d525-4a86-4d73-99d0-0254f6253a0a', None, None, None, None, None)] {{(pid=120412) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:23:17.886601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-72dd5c56-e87d-4ad9-bccc-733f0ddd2ad4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:17.894950 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-72dd5c56-e87d-4ad9-bccc-733f0ddd2ad4 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1506 microversion: 2.1 time: 0.157224 Sep 13 01:23:17.895522 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 305/602] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:17 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1506 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:18.209208 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Flavor limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:23:18.209568 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Image limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:23:18.210035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Flavor pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:23:18.210436 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Image pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:23:18.210865 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:23:18.219561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:18.220036 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:18.220463 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:18.221182 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:18.221626 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:18.222042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:18.237848 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Getting quotas for project 9056ec686513412a87c292387e25e870. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:23:18.241694 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Getting quotas for user 349e19300f1e48c3ac44fc34611c7f4a and project 9056ec686513412a87c292387e25e870. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:23:18.252761 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Going to run 1 instances... {{(pid=120412) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:23:18.255104 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120412) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:23:18.299441 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-af0c2127-500f-4f26-97c3-2019ae032724 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.553862 Sep 13 01:23:18.300003 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 298/603] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:23:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 555 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 01:23:18.311617 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b0b22a07-8d48-4b21-bf75-2e8563fd6a62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:18.312221 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b0b22a07-8d48-4b21-bf75-2e8563fd6a62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:18.367083 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b0b22a07-8d48-4b21-bf75-2e8563fd6a62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:18.374726 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b0b22a07-8d48-4b21-bf75-2e8563fd6a62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1237 microversion: 2.1 time: 0.067692 Sep 13 01:23:18.375719 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 306/604] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:18 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:18.682412 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3c6acd6d-bf19-4543-86f3-c5dfc411e149 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:18.683306 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3c6acd6d-bf19-4543-86f3-c5dfc411e149 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:18.691386 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3c6acd6d-bf19-4543-86f3-c5dfc411e149 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:18.691874 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3c6acd6d-bf19-4543-86f3-c5dfc411e149 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:18.692310 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3c6acd6d-bf19-4543-86f3-c5dfc411e149 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:18.693007 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3c6acd6d-bf19-4543-86f3-c5dfc411e149 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:18.693461 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3c6acd6d-bf19-4543-86f3-c5dfc411e149 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:18.693886 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3c6acd6d-bf19-4543-86f3-c5dfc411e149 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:18.825247 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3c6acd6d-bf19-4543-86f3-c5dfc411e149 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:18.832930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3c6acd6d-bf19-4543-86f3-c5dfc411e149 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.155152 Sep 13 01:23:18.833494 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 299/605] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:18 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:18.919092 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bf782a7c-14c9-42f0-900d-36440692fdc0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:18.919705 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bf782a7c-14c9-42f0-900d-36440692fdc0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:18.926127 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf782a7c-14c9-42f0-900d-36440692fdc0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:18.926608 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf782a7c-14c9-42f0-900d-36440692fdc0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:18.927071 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf782a7c-14c9-42f0-900d-36440692fdc0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:18.927760 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf782a7c-14c9-42f0-900d-36440692fdc0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:18.928214 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf782a7c-14c9-42f0-900d-36440692fdc0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:18.928635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf782a7c-14c9-42f0-900d-36440692fdc0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:19.057216 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bf782a7c-14c9-42f0-900d-36440692fdc0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:19.065028 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bf782a7c-14c9-42f0-900d-36440692fdc0 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1506 microversion: 2.1 time: 0.150427 Sep 13 01:23:19.065585 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 307/606] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:18 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1506 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:19.396940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-61b68a93-666e-4033-b7a5-d789dda64eb1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:19.397579 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-61b68a93-666e-4033-b7a5-d789dda64eb1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:19.403987 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-61b68a93-666e-4033-b7a5-d789dda64eb1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:19.404473 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-61b68a93-666e-4033-b7a5-d789dda64eb1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:19.404915 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-61b68a93-666e-4033-b7a5-d789dda64eb1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:19.405607 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-61b68a93-666e-4033-b7a5-d789dda64eb1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:19.406062 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-61b68a93-666e-4033-b7a5-d789dda64eb1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:19.406487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-61b68a93-666e-4033-b7a5-d789dda64eb1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:19.409203 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:19.469672 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-61b68a93-666e-4033-b7a5-d789dda64eb1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:19.477376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-61b68a93-666e-4033-b7a5-d789dda64eb1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1241 microversion: 2.1 time: 0.084265 Sep 13 01:23:19.477938 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 300/607] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:19 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:19.856910 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4c8a1e9f-a692-44a3-8cb8-8d78becae136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:19.857445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4c8a1e9f-a692-44a3-8cb8-8d78becae136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:19.863342 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c8a1e9f-a692-44a3-8cb8-8d78becae136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:19.863823 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c8a1e9f-a692-44a3-8cb8-8d78becae136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:19.864285 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c8a1e9f-a692-44a3-8cb8-8d78becae136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:19.864973 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c8a1e9f-a692-44a3-8cb8-8d78becae136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:19.865423 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c8a1e9f-a692-44a3-8cb8-8d78becae136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:19.865843 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4c8a1e9f-a692-44a3-8cb8-8d78becae136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:19.991815 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4c8a1e9f-a692-44a3-8cb8-8d78becae136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:20.000107 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4c8a1e9f-a692-44a3-8cb8-8d78becae136 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.147639 Sep 13 01:23:20.000675 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 308/608] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:19 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:20.087083 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-07556786-7a03-4e08-8320-81a3a3d635f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:20.087688 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-07556786-7a03-4e08-8320-81a3a3d635f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:20.094056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-07556786-7a03-4e08-8320-81a3a3d635f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:20.094546 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-07556786-7a03-4e08-8320-81a3a3d635f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:20.095090 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-07556786-7a03-4e08-8320-81a3a3d635f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:20.095780 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-07556786-7a03-4e08-8320-81a3a3d635f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:20.096236 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-07556786-7a03-4e08-8320-81a3a3d635f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:20.096662 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-07556786-7a03-4e08-8320-81a3a3d635f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:20.221462 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-07556786-7a03-4e08-8320-81a3a3d635f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:20.229011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-07556786-7a03-4e08-8320-81a3a3d635f6 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1506 microversion: 2.1 time: 0.145823 Sep 13 01:23:20.229576 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 301/609] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:20 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1506 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:20.499558 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-13a17088-0266-4bdb-9938-11625ddfad16 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:20.500173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-13a17088-0266-4bdb-9938-11625ddfad16 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:20.506078 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13a17088-0266-4bdb-9938-11625ddfad16 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:20.506578 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13a17088-0266-4bdb-9938-11625ddfad16 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:20.507079 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13a17088-0266-4bdb-9938-11625ddfad16 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:20.507784 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13a17088-0266-4bdb-9938-11625ddfad16 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:20.508376 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13a17088-0266-4bdb-9938-11625ddfad16 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:20.508808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-13a17088-0266-4bdb-9938-11625ddfad16 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:20.574195 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-13a17088-0266-4bdb-9938-11625ddfad16 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:20.586374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-13a17088-0266-4bdb-9938-11625ddfad16 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1289 microversion: 2.1 time: 0.090250 Sep 13 01:23:20.598877 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 309/610] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:20 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1289 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:21.023014 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b945d61a-54e1-4844-8fa4-7742832a68e7 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:21.023722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b945d61a-54e1-4844-8fa4-7742832a68e7 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:21.036438 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b945d61a-54e1-4844-8fa4-7742832a68e7 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:21.036930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b945d61a-54e1-4844-8fa4-7742832a68e7 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:21.037361 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b945d61a-54e1-4844-8fa4-7742832a68e7 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:21.038065 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b945d61a-54e1-4844-8fa4-7742832a68e7 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:21.038514 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b945d61a-54e1-4844-8fa4-7742832a68e7 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:21.038986 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b945d61a-54e1-4844-8fa4-7742832a68e7 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:21.253072 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-629fe524-a28f-42dc-8ebc-9fdb479925c5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:21.254362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-629fe524-a28f-42dc-8ebc-9fdb479925c5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:21.264838 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-629fe524-a28f-42dc-8ebc-9fdb479925c5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:21.265867 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-629fe524-a28f-42dc-8ebc-9fdb479925c5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:21.266624 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-629fe524-a28f-42dc-8ebc-9fdb479925c5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:21.267597 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-629fe524-a28f-42dc-8ebc-9fdb479925c5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:21.268210 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-629fe524-a28f-42dc-8ebc-9fdb479925c5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:21.268636 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-629fe524-a28f-42dc-8ebc-9fdb479925c5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:21.337796 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-629fe524-a28f-42dc-8ebc-9fdb479925c5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:21.347635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-629fe524-a28f-42dc-8ebc-9fdb479925c5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 200 len: 1464 microversion: 2.1 time: 0.099372 Sep 13 01:23:21.348453 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 310/611] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:21 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 1464 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:21.354488 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-35b4eb25-3365-4133-890c-c2cc25c2d989 req-106ab582-44d6-49bd-bd2a-ebb3d73d9c68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e628b0a-c70b-4c2b-b98e-339abc492871", "name": "network-vif-deleted", "tag": "1a2cf032-3cde-45a3-9e82-737d704d0b9f"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:21.366708 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b945d61a-54e1-4844-8fa4-7742832a68e7 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:21.369212 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-35b4eb25-3365-4133-890c-c2cc25c2d989 req-106ab582-44d6-49bd-bd2a-ebb3d73d9c68 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:21.369864 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-35b4eb25-3365-4133-890c-c2cc25c2d989 req-106ab582-44d6-49bd-bd2a-ebb3d73d9c68 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:21.370842 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-35b4eb25-3365-4133-890c-c2cc25c2d989 req-106ab582-44d6-49bd-bd2a-ebb3d73d9c68 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:21.377208 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b945d61a-54e1-4844-8fa4-7742832a68e7 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.358263 Sep 13 01:23:21.378106 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 302/612] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:21 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:21.386304 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-35b4eb25-3365-4133-890c-c2cc25c2d989 req-106ab582-44d6-49bd-bd2a-ebb3d73d9c68 service nova] Creating event network-vif-deleted:1a2cf032-3cde-45a3-9e82-737d704d0b9f for instance 2e628b0a-c70b-4c2b-b98e-339abc492871 on hv-cinder-85694 Sep 13 01:23:21.392501 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-35b4eb25-3365-4133-890c-c2cc25c2d989 req-106ab582-44d6-49bd-bd2a-ebb3d73d9c68 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042625 Sep 13 01:23:21.393334 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 311/613] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:21.615445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-17fbed04-c175-4d64-8f02-abdf1fcd612f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:21.616665 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-17fbed04-c175-4d64-8f02-abdf1fcd612f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:21.626372 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-17fbed04-c175-4d64-8f02-abdf1fcd612f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:21.626904 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-17fbed04-c175-4d64-8f02-abdf1fcd612f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:21.627335 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-17fbed04-c175-4d64-8f02-abdf1fcd612f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:21.628291 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-17fbed04-c175-4d64-8f02-abdf1fcd612f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:21.628751 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-17fbed04-c175-4d64-8f02-abdf1fcd612f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:21.629377 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-17fbed04-c175-4d64-8f02-abdf1fcd612f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:21.727154 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-17fbed04-c175-4d64-8f02-abdf1fcd612f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:21.736117 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-17fbed04-c175-4d64-8f02-abdf1fcd612f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1295 microversion: 2.1 time: 0.127367 Sep 13 01:23:21.736721 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 303/614] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:21 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1295 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:22.377276 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e88d734e-d046-4b05-a7ed-d40b229e956c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:22.378028 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e88d734e-d046-4b05-a7ed-d40b229e956c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 2e628b0a-c70b-4c2b-b98e-339abc492871] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:22.384845 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e88d734e-d046-4b05-a7ed-d40b229e956c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:22.385331 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e88d734e-d046-4b05-a7ed-d40b229e956c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:22.385766 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e88d734e-d046-4b05-a7ed-d40b229e956c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:22.387213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e88d734e-d046-4b05-a7ed-d40b229e956c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:22.387822 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e88d734e-d046-4b05-a7ed-d40b229e956c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:22.388424 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e88d734e-d046-4b05-a7ed-d40b229e956c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:22.401622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-084057cb-c434-4e59-acf8-da7d11ac7fa4 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:22.402973 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-084057cb-c434-4e59-acf8-da7d11ac7fa4 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:22.403143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-e88d734e-d046-4b05-a7ed-d40b229e956c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] HTTP exception thrown: Instance 2e628b0a-c70b-4c2b-b98e-339abc492871 could not be found. Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e88d734e-d046-4b05-a7ed-d40b229e956c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Request method failure captured: Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 HTTP/1.1 Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9p4yMnrVK5GewsWLbTcRAz16uSc9TtrMuEljQX8sg0PXiBEAwAlB55augWK15AhNuOWCJg7_s89STcx-xwzZQh-CvS_k-5n7S0zKWbadfn4euhiUxAhZtEB4z7zlDtF2ivu7J04PPQiqOpRhilIzjzrHVHn7cC4gXETDbD4QP7c8NI Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: a84dd36fe9484f41bc2f0d7da4e47c13 Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:23:22.404773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:23:22.406043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a84dd36fe9484f41bc2f0d7da4e47c13"}]}] Sep 13 01:23:22.406043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:23:22.406043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: a84dd36fe9484f41bc2f0d7da4e47c13 Sep 13 01:23:22.406043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:23:22.406043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-ServerRescueNegativeTestJSON-293179200-project Sep 13 01:23:22.406043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:23:22.406043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:23:22.406043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 0c5dcfa5794843a5896fa051a4554e1f Sep 13 01:23:22.406043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-ServerRescueNegativeTestJSON-293179200-project Sep 13 01:23:22.406043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:23:22.406043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 2e628b0a-c70b-4c2b-b98e-339abc492871 could not be found. Sep 13 01:23:22.406043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '2e628b0a-c70b-4c2b-b98e-339abc492871'} Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e628b0a-c70b-4c2b-b98e-339abc492871 could not be found. Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:23:22.406739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e628b0a-c70b-4c2b-b98e-339abc492871 could not be found. Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e628b0a-c70b-4c2b-b98e-339abc492871 could not be found. Sep 13 01:23:22.408575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:22.410617 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e88d734e-d046-4b05-a7ed-d40b229e956c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Returning 404 to user: Instance 2e628b0a-c70b-4c2b-b98e-339abc492871 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:23:22.410617 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e88d734e-d046-4b05-a7ed-d40b229e956c tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871" status: 404 len: 111 microversion: 2.1 time: 0.033270 Sep 13 01:23:22.410617 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 312/615] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:22 2022] GET /compute/v2.1/servers/2e628b0a-c70b-4c2b-b98e-339abc492871 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:23:22.418435 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a62d96ca-7f93-4cc0-8320-d31aa4040972 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:22.418743 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-084057cb-c434-4e59-acf8-da7d11ac7fa4 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:22.418963 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a62d96ca-7f93-4cc0-8320-d31aa4040972 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:22.419423 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-084057cb-c434-4e59-acf8-da7d11ac7fa4 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:22.419940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-084057cb-c434-4e59-acf8-da7d11ac7fa4 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:22.421401 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-084057cb-c434-4e59-acf8-da7d11ac7fa4 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:22.422278 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-084057cb-c434-4e59-acf8-da7d11ac7fa4 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:22.422833 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-084057cb-c434-4e59-acf8-da7d11ac7fa4 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:22.425547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a62d96ca-7f93-4cc0-8320-d31aa4040972 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:22.426227 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a62d96ca-7f93-4cc0-8320-d31aa4040972 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:22.426759 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a62d96ca-7f93-4cc0-8320-d31aa4040972 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:22.427558 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a62d96ca-7f93-4cc0-8320-d31aa4040972 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:22.428010 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a62d96ca-7f93-4cc0-8320-d31aa4040972 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:22.428781 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a62d96ca-7f93-4cc0-8320-d31aa4040972 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:22.455570 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a62d96ca-7f93-4cc0-8320-d31aa4040972 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:23:22.551640 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a62d96ca-7f93-4cc0-8320-d31aa4040972 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 204 len: 0 microversion: 2.1 time: 0.138726 Sep 13 01:23:22.552610 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 313/616] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:23:22 2022] DELETE /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 01:23:22.564685 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6a6dee1d-e993-4bde-a4f3-483e89ec7828 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:22.566631 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6a6dee1d-e993-4bde-a4f3-483e89ec7828 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:22.569121 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:22.576115 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6a6dee1d-e993-4bde-a4f3-483e89ec7828 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:22.577399 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6a6dee1d-e993-4bde-a4f3-483e89ec7828 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:22.577851 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6a6dee1d-e993-4bde-a4f3-483e89ec7828 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:22.578573 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6a6dee1d-e993-4bde-a4f3-483e89ec7828 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:22.579065 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6a6dee1d-e993-4bde-a4f3-483e89ec7828 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:22.579495 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6a6dee1d-e993-4bde-a4f3-483e89ec7828 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:22.653182 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-084057cb-c434-4e59-acf8-da7d11ac7fa4 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:22.662489 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-084057cb-c434-4e59-acf8-da7d11ac7fa4 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.264795 Sep 13 01:23:22.675070 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 304/617] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:22 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:22.720640 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6a6dee1d-e993-4bde-a4f3-483e89ec7828 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:22.729956 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6a6dee1d-e993-4bde-a4f3-483e89ec7828 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.172365 Sep 13 01:23:22.730689 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 314/618] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:22 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:22.761123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ddf60e7e-ce67-4bf5-9ee5-77a6760ce21e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:22.762350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ddf60e7e-ce67-4bf5-9ee5-77a6760ce21e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:22.768323 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ddf60e7e-ce67-4bf5-9ee5-77a6760ce21e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:22.768924 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ddf60e7e-ce67-4bf5-9ee5-77a6760ce21e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:22.769380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ddf60e7e-ce67-4bf5-9ee5-77a6760ce21e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:22.770161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ddf60e7e-ce67-4bf5-9ee5-77a6760ce21e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:22.770612 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ddf60e7e-ce67-4bf5-9ee5-77a6760ce21e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:22.771149 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ddf60e7e-ce67-4bf5-9ee5-77a6760ce21e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:22.906738 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ddf60e7e-ce67-4bf5-9ee5-77a6760ce21e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:22.914216 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ddf60e7e-ce67-4bf5-9ee5-77a6760ce21e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1362 microversion: 2.1 time: 0.156875 Sep 13 01:23:22.914779 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 305/619] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:22 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:23.411739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-6e8ec692-3ba8-487c-8bba-be8c1861660c req-80d90ab5-4bc8-450a-810e-c804a85a36f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad33c0aa-a0d0-423b-a979-7e448b85cf2a", "tag": "6a0f0882-0ddc-43dd-a35a-31a905ab84e6"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:23.422030 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6e8ec692-3ba8-487c-8bba-be8c1861660c req-80d90ab5-4bc8-450a-810e-c804a85a36f3 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:23.422512 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6e8ec692-3ba8-487c-8bba-be8c1861660c req-80d90ab5-4bc8-450a-810e-c804a85a36f3 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:23.422974 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6e8ec692-3ba8-487c-8bba-be8c1861660c req-80d90ab5-4bc8-450a-810e-c804a85a36f3 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:23.433628 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-6e8ec692-3ba8-487c-8bba-be8c1861660c req-80d90ab5-4bc8-450a-810e-c804a85a36f3 service nova] Creating event network-changed:6a0f0882-0ddc-43dd-a35a-31a905ab84e6 for instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a on hv-cinder-85694 Sep 13 01:23:23.438202 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-6e8ec692-3ba8-487c-8bba-be8c1861660c req-80d90ab5-4bc8-450a-810e-c804a85a36f3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030339 Sep 13 01:23:23.438774 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 315/620] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:23.687571 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1894329d-423d-4d69-963d-dc0df65abf41 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:23.688109 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1894329d-423d-4d69-963d-dc0df65abf41 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:23.694446 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1894329d-423d-4d69-963d-dc0df65abf41 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:23.694956 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1894329d-423d-4d69-963d-dc0df65abf41 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:23.695386 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1894329d-423d-4d69-963d-dc0df65abf41 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:23.696067 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1894329d-423d-4d69-963d-dc0df65abf41 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:23.696521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1894329d-423d-4d69-963d-dc0df65abf41 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:23.696940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1894329d-423d-4d69-963d-dc0df65abf41 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:23.753325 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-aafde42c-32c0-46d7-a3a8-ddcd9ecc2e3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:23.754154 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-aafde42c-32c0-46d7-a3a8-ddcd9ecc2e3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:23.760467 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aafde42c-32c0-46d7-a3a8-ddcd9ecc2e3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:23.760985 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aafde42c-32c0-46d7-a3a8-ddcd9ecc2e3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:23.761919 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aafde42c-32c0-46d7-a3a8-ddcd9ecc2e3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:23.762617 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aafde42c-32c0-46d7-a3a8-ddcd9ecc2e3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:23.763112 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aafde42c-32c0-46d7-a3a8-ddcd9ecc2e3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:23.763540 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aafde42c-32c0-46d7-a3a8-ddcd9ecc2e3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:23.767799 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:23.827413 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1894329d-423d-4d69-963d-dc0df65abf41 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:23.835061 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1894329d-423d-4d69-963d-dc0df65abf41 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.151458 Sep 13 01:23:23.835716 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 306/621] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:23 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:23.893484 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-aafde42c-32c0-46d7-a3a8-ddcd9ecc2e3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:23.901092 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-aafde42c-32c0-46d7-a3a8-ddcd9ecc2e3f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.151962 Sep 13 01:23:23.901660 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 316/622] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:23 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:23.937131 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-628a1bb3-3b4d-4bf9-b867-17c8df01ed58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:23.937789 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-628a1bb3-3b4d-4bf9-b867-17c8df01ed58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:23.943611 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-628a1bb3-3b4d-4bf9-b867-17c8df01ed58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:23.944089 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-628a1bb3-3b4d-4bf9-b867-17c8df01ed58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:23.944521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-628a1bb3-3b4d-4bf9-b867-17c8df01ed58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:23.945201 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-628a1bb3-3b4d-4bf9-b867-17c8df01ed58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:23.945653 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-628a1bb3-3b4d-4bf9-b867-17c8df01ed58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:23.946067 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-628a1bb3-3b4d-4bf9-b867-17c8df01ed58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:24.075043 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-628a1bb3-3b4d-4bf9-b867-17c8df01ed58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:24.082495 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-628a1bb3-3b4d-4bf9-b867-17c8df01ed58 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1362 microversion: 2.1 time: 0.149436 Sep 13 01:23:24.083094 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 307/623] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:23 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:24.859273 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0031a06c-39e0-4745-9de2-1d18f643c69d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:24.859887 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0031a06c-39e0-4745-9de2-1d18f643c69d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:24.866251 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0031a06c-39e0-4745-9de2-1d18f643c69d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:24.866751 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0031a06c-39e0-4745-9de2-1d18f643c69d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:24.867200 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0031a06c-39e0-4745-9de2-1d18f643c69d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:24.867891 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0031a06c-39e0-4745-9de2-1d18f643c69d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:24.868347 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0031a06c-39e0-4745-9de2-1d18f643c69d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:24.868770 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0031a06c-39e0-4745-9de2-1d18f643c69d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:24.924863 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c807cdb3-438b-4ad5-9eb1-597853d8156f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:24.925491 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c807cdb3-438b-4ad5-9eb1-597853d8156f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:24.931978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c807cdb3-438b-4ad5-9eb1-597853d8156f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:24.932466 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c807cdb3-438b-4ad5-9eb1-597853d8156f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:24.933153 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c807cdb3-438b-4ad5-9eb1-597853d8156f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:24.933898 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c807cdb3-438b-4ad5-9eb1-597853d8156f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:24.934347 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c807cdb3-438b-4ad5-9eb1-597853d8156f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:24.934767 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c807cdb3-438b-4ad5-9eb1-597853d8156f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:25.001285 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0031a06c-39e0-4745-9de2-1d18f643c69d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:25.009245 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0031a06c-39e0-4745-9de2-1d18f643c69d tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.154435 Sep 13 01:23:25.010122 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 317/624] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:24 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:25.060142 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c807cdb3-438b-4ad5-9eb1-597853d8156f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:25.067782 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c807cdb3-438b-4ad5-9eb1-597853d8156f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.146825 Sep 13 01:23:25.068349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 308/625] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:24 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:25.104057 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c4a4f482-6639-4b0d-8025-77bd5d631d68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:25.104667 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c4a4f482-6639-4b0d-8025-77bd5d631d68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:25.111257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4a4f482-6639-4b0d-8025-77bd5d631d68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:25.111684 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4a4f482-6639-4b0d-8025-77bd5d631d68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:25.112120 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4a4f482-6639-4b0d-8025-77bd5d631d68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:25.112814 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4a4f482-6639-4b0d-8025-77bd5d631d68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:25.113268 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4a4f482-6639-4b0d-8025-77bd5d631d68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:25.113688 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4a4f482-6639-4b0d-8025-77bd5d631d68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:25.238950 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c4a4f482-6639-4b0d-8025-77bd5d631d68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:25.246370 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c4a4f482-6639-4b0d-8025-77bd5d631d68 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1362 microversion: 2.1 time: 0.146076 Sep 13 01:23:25.246953 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 318/626] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:25 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:26.032165 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0351acc9-2025-4523-93e1-b7308bf6ac09 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:26.032776 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0351acc9-2025-4523-93e1-b7308bf6ac09 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:26.039306 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0351acc9-2025-4523-93e1-b7308bf6ac09 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:26.039786 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0351acc9-2025-4523-93e1-b7308bf6ac09 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:26.040217 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0351acc9-2025-4523-93e1-b7308bf6ac09 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:26.040904 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0351acc9-2025-4523-93e1-b7308bf6ac09 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:26.041358 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0351acc9-2025-4523-93e1-b7308bf6ac09 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:26.041775 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0351acc9-2025-4523-93e1-b7308bf6ac09 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:26.090283 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-adcb3b67-46b4-4fd3-b04f-ca3964e17b6b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:26.091026 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-adcb3b67-46b4-4fd3-b04f-ca3964e17b6b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:26.097534 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-adcb3b67-46b4-4fd3-b04f-ca3964e17b6b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:26.098119 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-adcb3b67-46b4-4fd3-b04f-ca3964e17b6b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:26.098628 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-adcb3b67-46b4-4fd3-b04f-ca3964e17b6b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:26.099428 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-adcb3b67-46b4-4fd3-b04f-ca3964e17b6b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:26.099959 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-adcb3b67-46b4-4fd3-b04f-ca3964e17b6b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:26.100450 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-adcb3b67-46b4-4fd3-b04f-ca3964e17b6b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:26.234241 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-adcb3b67-46b4-4fd3-b04f-ca3964e17b6b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:26.242255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-adcb3b67-46b4-4fd3-b04f-ca3964e17b6b tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1521 microversion: 2.1 time: 0.155795 Sep 13 01:23:26.242966 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 319/627] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:26 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:26.271796 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6aef49de-8ce3-4118-ba71-a7a10fe42d52 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:26.272567 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6aef49de-8ce3-4118-ba71-a7a10fe42d52 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:26.278544 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6aef49de-8ce3-4118-ba71-a7a10fe42d52 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:26.279148 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6aef49de-8ce3-4118-ba71-a7a10fe42d52 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:26.279597 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6aef49de-8ce3-4118-ba71-a7a10fe42d52 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:26.280298 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6aef49de-8ce3-4118-ba71-a7a10fe42d52 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:26.280756 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6aef49de-8ce3-4118-ba71-a7a10fe42d52 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:26.281188 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6aef49de-8ce3-4118-ba71-a7a10fe42d52 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:26.412334 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6aef49de-8ce3-4118-ba71-a7a10fe42d52 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:26.420179 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6aef49de-8ce3-4118-ba71-a7a10fe42d52 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1362 microversion: 2.1 time: 0.152444 Sep 13 01:23:26.420755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 320/628] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:26 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:26.529336 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0351acc9-2025-4523-93e1-b7308bf6ac09 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:26.537105 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0351acc9-2025-4523-93e1-b7308bf6ac09 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.508723 Sep 13 01:23:26.537885 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 309/629] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:26 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:27.265887 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-64c672d8-d109-47dd-8c0b-4ce90bd95e0f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:27.266551 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-64c672d8-d109-47dd-8c0b-4ce90bd95e0f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:27.273135 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64c672d8-d109-47dd-8c0b-4ce90bd95e0f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:27.273622 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64c672d8-d109-47dd-8c0b-4ce90bd95e0f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:27.274060 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64c672d8-d109-47dd-8c0b-4ce90bd95e0f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:27.274756 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64c672d8-d109-47dd-8c0b-4ce90bd95e0f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:27.275237 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64c672d8-d109-47dd-8c0b-4ce90bd95e0f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:27.275663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64c672d8-d109-47dd-8c0b-4ce90bd95e0f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:27.344511 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-64c672d8-d109-47dd-8c0b-4ce90bd95e0f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:27.353192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-64c672d8-d109-47dd-8c0b-4ce90bd95e0f tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1479 microversion: 2.1 time: 0.091124 Sep 13 01:23:27.353962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 321/630] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:27 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1479 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:27.443733 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-00e90f38-41ad-49d7-ad62-dc487fea43b3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:27.444344 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-00e90f38-41ad-49d7-ad62-dc487fea43b3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:27.451784 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-00e90f38-41ad-49d7-ad62-dc487fea43b3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:27.452433 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-00e90f38-41ad-49d7-ad62-dc487fea43b3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:27.452988 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-00e90f38-41ad-49d7-ad62-dc487fea43b3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:27.453750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-00e90f38-41ad-49d7-ad62-dc487fea43b3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:27.454370 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-00e90f38-41ad-49d7-ad62-dc487fea43b3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:27.454975 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-00e90f38-41ad-49d7-ad62-dc487fea43b3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:27.497516 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-370ef13d-3a64-41fb-a4eb-9d2d03293eb6 req-e3210590-1c8c-4a43-ab92-ab86bc3ab521 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0091ed80-cb3c-4dce-b54c-48989fb19e7b", "name": "network-vif-deleted", "tag": "af4f2d52-b899-4598-a65e-5404eb758ac3"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:27.506630 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-370ef13d-3a64-41fb-a4eb-9d2d03293eb6 req-e3210590-1c8c-4a43-ab92-ab86bc3ab521 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:27.507142 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-370ef13d-3a64-41fb-a4eb-9d2d03293eb6 req-e3210590-1c8c-4a43-ab92-ab86bc3ab521 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:27.507568 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-370ef13d-3a64-41fb-a4eb-9d2d03293eb6 req-e3210590-1c8c-4a43-ab92-ab86bc3ab521 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:27.518918 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-370ef13d-3a64-41fb-a4eb-9d2d03293eb6 req-e3210590-1c8c-4a43-ab92-ab86bc3ab521 service nova] Creating event network-vif-deleted:af4f2d52-b899-4598-a65e-5404eb758ac3 for instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b on hv-cinder-85694 Sep 13 01:23:27.523917 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-370ef13d-3a64-41fb-a4eb-9d2d03293eb6 req-e3210590-1c8c-4a43-ab92-ab86bc3ab521 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030382 Sep 13 01:23:27.524504 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 322/631] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:23:27.561422 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c80f662a-b435-48c9-a0a8-4c8f400a4623 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:27.562272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c80f662a-b435-48c9-a0a8-4c8f400a4623 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:27.568561 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c80f662a-b435-48c9-a0a8-4c8f400a4623 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:27.569129 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c80f662a-b435-48c9-a0a8-4c8f400a4623 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:27.569485 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c80f662a-b435-48c9-a0a8-4c8f400a4623 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:27.570196 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c80f662a-b435-48c9-a0a8-4c8f400a4623 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:27.570726 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c80f662a-b435-48c9-a0a8-4c8f400a4623 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:27.581941 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c80f662a-b435-48c9-a0a8-4c8f400a4623 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:27.674543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-00e90f38-41ad-49d7-ad62-dc487fea43b3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:27.682529 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-00e90f38-41ad-49d7-ad62-dc487fea43b3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1362 microversion: 2.1 time: 0.242653 Sep 13 01:23:27.695474 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 310/632] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:27 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1362 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:27.736174 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c80f662a-b435-48c9-a0a8-4c8f400a4623 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:27.744127 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c80f662a-b435-48c9-a0a8-4c8f400a4623 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.187104 Sep 13 01:23:27.744704 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 323/633] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:27 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:28.378045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-25ea1d20-c36d-47cd-b604-f642be623009 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:28.378656 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-25ea1d20-c36d-47cd-b604-f642be623009 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:28.380530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:28.381166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=6 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:28.381826 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:28.388302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-25ea1d20-c36d-47cd-b604-f642be623009 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:28.388782 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-25ea1d20-c36d-47cd-b604-f642be623009 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:28.389216 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-25ea1d20-c36d-47cd-b604-f642be623009 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:28.389902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-25ea1d20-c36d-47cd-b604-f642be623009 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:28.390356 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-25ea1d20-c36d-47cd-b604-f642be623009 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:28.390779 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-25ea1d20-c36d-47cd-b604-f642be623009 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:28.456513 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-25ea1d20-c36d-47cd-b604-f642be623009 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:28.464086 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-25ea1d20-c36d-47cd-b604-f642be623009 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1307 microversion: 2.1 time: 0.089949 Sep 13 01:23:28.465226 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 311/634] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:28 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1307 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:28.705904 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-00151255-3cd2-45cd-9ee1-147e6e1a0cd2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:28.706504 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-00151255-3cd2-45cd-9ee1-147e6e1a0cd2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:28.708919 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=6 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:28.714307 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-00151255-3cd2-45cd-9ee1-147e6e1a0cd2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:28.715324 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-00151255-3cd2-45cd-9ee1-147e6e1a0cd2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:28.715758 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-00151255-3cd2-45cd-9ee1-147e6e1a0cd2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:28.716437 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-00151255-3cd2-45cd-9ee1-147e6e1a0cd2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:28.716880 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-00151255-3cd2-45cd-9ee1-147e6e1a0cd2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:28.717295 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-00151255-3cd2-45cd-9ee1-147e6e1a0cd2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:28.767331 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4b151cbe-67c6-4215-a4bb-ba8423590802 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:28.767974 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4b151cbe-67c6-4215-a4bb-ba8423590802 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:28.773986 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4b151cbe-67c6-4215-a4bb-ba8423590802 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:28.774474 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4b151cbe-67c6-4215-a4bb-ba8423590802 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:28.774932 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4b151cbe-67c6-4215-a4bb-ba8423590802 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:28.775624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4b151cbe-67c6-4215-a4bb-ba8423590802 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:28.776082 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4b151cbe-67c6-4215-a4bb-ba8423590802 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:28.776498 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4b151cbe-67c6-4215-a4bb-ba8423590802 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:28.848148 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-00151255-3cd2-45cd-9ee1-147e6e1a0cd2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:28.857035 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-00151255-3cd2-45cd-9ee1-147e6e1a0cd2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1362 microversion: 2.1 time: 0.154881 Sep 13 01:23:28.857613 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 324/635] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:28 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:28.905449 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4b151cbe-67c6-4215-a4bb-ba8423590802 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:28.916035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4b151cbe-67c6-4215-a4bb-ba8423590802 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.152237 Sep 13 01:23:28.916947 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 312/636] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:28 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:29.487388 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:29.488007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:29.493949 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:29.494437 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:29.494895 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:29.495594 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:29.496050 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:29.496475 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:29.531373 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:29.531863 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:29.532305 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:29.532755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lazy-loading 'fault' on Instance uuid 0091ed80-cb3c-4dce-b54c-48989fb19e7b {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:23:29.574018 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0c5dcfa5794843a5896fa051a4554e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a84dd36fe9484f41bc2f0d7da4e47c13', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:29.581755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c4f30e4d-2110-46a9-bbde-39649698f5f5 tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 200 len: 1312 microversion: 2.1 time: 0.098201 Sep 13 01:23:29.582328 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 325/637] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:29 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 1312 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:29.881869 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1bd1bf92-06ad-483c-8073-2da122304a88 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:29.882642 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1bd1bf92-06ad-483c-8073-2da122304a88 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:29.889186 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1bd1bf92-06ad-483c-8073-2da122304a88 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:29.889666 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1bd1bf92-06ad-483c-8073-2da122304a88 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:29.890100 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1bd1bf92-06ad-483c-8073-2da122304a88 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:29.890791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1bd1bf92-06ad-483c-8073-2da122304a88 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:29.891270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1bd1bf92-06ad-483c-8073-2da122304a88 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:29.891688 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1bd1bf92-06ad-483c-8073-2da122304a88 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:29.939904 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fdecdb3d-99d2-4648-8b10-af269d7cf892 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:29.940521 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fdecdb3d-99d2-4648-8b10-af269d7cf892 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:29.952445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fdecdb3d-99d2-4648-8b10-af269d7cf892 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:29.952944 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fdecdb3d-99d2-4648-8b10-af269d7cf892 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:29.953380 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fdecdb3d-99d2-4648-8b10-af269d7cf892 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:29.954098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fdecdb3d-99d2-4648-8b10-af269d7cf892 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:29.954551 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fdecdb3d-99d2-4648-8b10-af269d7cf892 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:29.955003 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fdecdb3d-99d2-4648-8b10-af269d7cf892 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:30.047467 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1bd1bf92-06ad-483c-8073-2da122304a88 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:30.055852 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1bd1bf92-06ad-483c-8073-2da122304a88 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1362 microversion: 2.1 time: 0.178870 Sep 13 01:23:30.066651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 313/638] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:29 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:30.107476 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fdecdb3d-99d2-4648-8b10-af269d7cf892 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:30.115518 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fdecdb3d-99d2-4648-8b10-af269d7cf892 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.179800 Sep 13 01:23:30.116027 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 326/639] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:29 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:30.604651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-28a1ade4-4d69-4f36-8206-b1c28bb2dcdd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:30.605797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-28a1ade4-4d69-4f36-8206-b1c28bb2dcdd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] [instance: 0091ed80-cb3c-4dce-b54c-48989fb19e7b] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:30.611992 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-28a1ade4-4d69-4f36-8206-b1c28bb2dcdd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:30.612555 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-28a1ade4-4d69-4f36-8206-b1c28bb2dcdd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:30.613065 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-28a1ade4-4d69-4f36-8206-b1c28bb2dcdd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:30.613857 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-28a1ade4-4d69-4f36-8206-b1c28bb2dcdd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:30.614448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-28a1ade4-4d69-4f36-8206-b1c28bb2dcdd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:30.614697 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-28a1ade4-4d69-4f36-8206-b1c28bb2dcdd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:30.631386 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-28a1ade4-4d69-4f36-8206-b1c28bb2dcdd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] HTTP exception thrown: Instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b could not be found. Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-28a1ade4-4d69-4f36-8206-b1c28bb2dcdd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Request method failure captured: Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b HTTP/1.1 Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9p4yMnrVK5GewsWLbTcRAz16uSc9TtrMuEljQX8sg0PXiBEAwAlB55augWK15AhNuOWCJg7_s89STcx-xwzZQh-CvS_k-5n7S0zKWbadfn4euhiUxAhZtEB4z7zlDtF2ivu7J04PPQiqOpRhilIzjzrHVHn7cC4gXETDbD4QP7c8NI Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: a84dd36fe9484f41bc2f0d7da4e47c13 Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:23:30.633899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:23:30.635610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/a84dd36fe9484f41bc2f0d7da4e47c13"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/a84dd36fe9484f41bc2f0d7da4e47c13"}]}] Sep 13 01:23:30.635610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:23:30.635610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: a84dd36fe9484f41bc2f0d7da4e47c13 Sep 13 01:23:30.635610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-293179200 Sep 13 01:23:30.635610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-ServerRescueNegativeTestJSON-293179200-project Sep 13 01:23:30.635610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:23:30.635610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:23:30.635610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 0c5dcfa5794843a5896fa051a4554e1f Sep 13 01:23:30.635610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-ServerRescueNegativeTestJSON-293179200-project Sep 13 01:23:30.635610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:23:30.635610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b could not be found. Sep 13 01:23:30.635610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '0091ed80-cb3c-4dce-b54c-48989fb19e7b'} Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b could not be found. Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:23:30.636965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b could not be found. Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b could not be found. Sep 13 01:23:30.638816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:23:30.640951 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-28a1ade4-4d69-4f36-8206-b1c28bb2dcdd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] Returning 404 to user: Instance 0091ed80-cb3c-4dce-b54c-48989fb19e7b could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:23:30.640951 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-28a1ade4-4d69-4f36-8206-b1c28bb2dcdd tempest-ServerRescueNegativeTestJSON-293179200 tempest-ServerRescueNegativeTestJSON-293179200-project] 10.222.0.15 "GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b" status: 404 len: 111 microversion: 2.1 time: 0.034589 Sep 13 01:23:30.640951 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 314/640] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:30 2022] GET /compute/v2.1/servers/0091ed80-cb3c-4dce-b54c-48989fb19e7b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:23:31.080352 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6865d2eb-7e8c-4c16-91ab-7b48f357a3c3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:31.080950 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6865d2eb-7e8c-4c16-91ab-7b48f357a3c3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:31.087282 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6865d2eb-7e8c-4c16-91ab-7b48f357a3c3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:31.087766 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6865d2eb-7e8c-4c16-91ab-7b48f357a3c3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:31.088200 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6865d2eb-7e8c-4c16-91ab-7b48f357a3c3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:31.088906 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6865d2eb-7e8c-4c16-91ab-7b48f357a3c3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:31.089830 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6865d2eb-7e8c-4c16-91ab-7b48f357a3c3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:31.090280 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6865d2eb-7e8c-4c16-91ab-7b48f357a3c3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:31.139903 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ce575f69-711c-462d-a8db-444cf292d020 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:31.140490 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ce575f69-711c-462d-a8db-444cf292d020 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:31.146936 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ce575f69-711c-462d-a8db-444cf292d020 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:31.147543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ce575f69-711c-462d-a8db-444cf292d020 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:31.148298 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ce575f69-711c-462d-a8db-444cf292d020 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:31.148829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ce575f69-711c-462d-a8db-444cf292d020 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:31.149293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ce575f69-711c-462d-a8db-444cf292d020 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:31.149948 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ce575f69-711c-462d-a8db-444cf292d020 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:31.283241 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ce575f69-711c-462d-a8db-444cf292d020 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:31.290928 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ce575f69-711c-462d-a8db-444cf292d020 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1508 microversion: 2.1 time: 0.155239 Sep 13 01:23:31.291817 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 315/641] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:31 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:31.314159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0bb66a80-45ff-47b8-b33a-d6c1130f84b9 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:31.314759 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0bb66a80-45ff-47b8-b33a-d6c1130f84b9 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:31.320815 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bb66a80-45ff-47b8-b33a-d6c1130f84b9 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:31.321303 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bb66a80-45ff-47b8-b33a-d6c1130f84b9 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:31.321741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bb66a80-45ff-47b8-b33a-d6c1130f84b9 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:31.322432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bb66a80-45ff-47b8-b33a-d6c1130f84b9 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:31.323083 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bb66a80-45ff-47b8-b33a-d6c1130f84b9 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:31.323508 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bb66a80-45ff-47b8-b33a-d6c1130f84b9 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:31.352500 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0bb66a80-45ff-47b8-b33a-d6c1130f84b9 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120412) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 01:23:31.366102 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6865d2eb-7e8c-4c16-91ab-7b48f357a3c3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:31.375308 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6865d2eb-7e8c-4c16-91ab-7b48f357a3c3 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1362 microversion: 2.1 time: 0.298428 Sep 13 01:23:31.375911 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 327/642] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:31 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1362 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:31.394536 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:31.419697 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0bb66a80-45ff-47b8-b33a-d6c1130f84b9 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "POST /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72/action" status: 202 len: 0 microversion: 2.1 time: 0.109395 Sep 13 01:23:31.420683 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 316/643] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:23:31 2022] POST /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 13 01:23:31.428768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ef353516-194c-43f8-956f-7d60972ad26e tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:31.429921 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ef353516-194c-43f8-956f-7d60972ad26e tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:31.436366 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ef353516-194c-43f8-956f-7d60972ad26e tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:31.436923 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ef353516-194c-43f8-956f-7d60972ad26e tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:31.437535 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ef353516-194c-43f8-956f-7d60972ad26e tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:31.438409 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ef353516-194c-43f8-956f-7d60972ad26e tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:31.439070 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ef353516-194c-43f8-956f-7d60972ad26e tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:31.439639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ef353516-194c-43f8-956f-7d60972ad26e tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:31.669897 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ef353516-194c-43f8-956f-7d60972ad26e tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:31.686639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ef353516-194c-43f8-956f-7d60972ad26e tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1516 microversion: 2.1 time: 0.257604 Sep 13 01:23:31.687760 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 328/644] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:31 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1516 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:32.399930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-044fec33-bfbf-40d7-9b9f-38e9fcca9df6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:32.401120 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-044fec33-bfbf-40d7-9b9f-38e9fcca9df6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:32.407899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-044fec33-bfbf-40d7-9b9f-38e9fcca9df6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:32.408630 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-044fec33-bfbf-40d7-9b9f-38e9fcca9df6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:32.409245 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-044fec33-bfbf-40d7-9b9f-38e9fcca9df6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:32.410120 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-044fec33-bfbf-40d7-9b9f-38e9fcca9df6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:32.410736 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-044fec33-bfbf-40d7-9b9f-38e9fcca9df6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:32.411342 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-044fec33-bfbf-40d7-9b9f-38e9fcca9df6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:32.559373 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-044fec33-bfbf-40d7-9b9f-38e9fcca9df6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:32.576839 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-044fec33-bfbf-40d7-9b9f-38e9fcca9df6 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1362 microversion: 2.1 time: 0.181105 Sep 13 01:23:32.577510 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 317/645] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:32 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:32.712310 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-91fbd57f-6922-4277-a54d-4334fe6f01f6 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:32.712843 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-91fbd57f-6922-4277-a54d-4334fe6f01f6 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:32.719383 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91fbd57f-6922-4277-a54d-4334fe6f01f6 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:32.720114 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91fbd57f-6922-4277-a54d-4334fe6f01f6 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:32.720550 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91fbd57f-6922-4277-a54d-4334fe6f01f6 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:32.721388 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91fbd57f-6922-4277-a54d-4334fe6f01f6 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:32.722017 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91fbd57f-6922-4277-a54d-4334fe6f01f6 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:32.723143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-91fbd57f-6922-4277-a54d-4334fe6f01f6 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:32.957463 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-91fbd57f-6922-4277-a54d-4334fe6f01f6 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:32.967741 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-91fbd57f-6922-4277-a54d-4334fe6f01f6 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1518 microversion: 2.1 time: 0.259395 Sep 13 01:23:32.969404 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 329/646] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:32 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1518 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:33.599952 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f76e4ec5-9124-4a06-a86f-535f80dbeb60 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:33.600576 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-f76e4ec5-9124-4a06-a86f-535f80dbeb60 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:33.614122 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f76e4ec5-9124-4a06-a86f-535f80dbeb60 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:33.614629 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f76e4ec5-9124-4a06-a86f-535f80dbeb60 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:33.615104 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f76e4ec5-9124-4a06-a86f-535f80dbeb60 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:33.615816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f76e4ec5-9124-4a06-a86f-535f80dbeb60 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:33.616467 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f76e4ec5-9124-4a06-a86f-535f80dbeb60 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:33.617042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f76e4ec5-9124-4a06-a86f-535f80dbeb60 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:33.821700 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-9a0e3b0e-d108-4a32-980e-074be6da1163 req-76c4256d-2c89-4bf9-80db-51bdc489b153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad33c0aa-a0d0-423b-a979-7e448b85cf2a", "name": "network-vif-plugged", "status": "completed", "tag": "6a0f0882-0ddc-43dd-a35a-31a905ab84e6"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:33.836814 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-9a0e3b0e-d108-4a32-980e-074be6da1163 req-76c4256d-2c89-4bf9-80db-51bdc489b153 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:33.837901 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-9a0e3b0e-d108-4a32-980e-074be6da1163 req-76c4256d-2c89-4bf9-80db-51bdc489b153 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:33.840732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-9a0e3b0e-d108-4a32-980e-074be6da1163 req-76c4256d-2c89-4bf9-80db-51bdc489b153 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:33.857784 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-9a0e3b0e-d108-4a32-980e-074be6da1163 req-76c4256d-2c89-4bf9-80db-51bdc489b153 service nova] Creating event network-vif-plugged:6a0f0882-0ddc-43dd-a35a-31a905ab84e6 for instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a on hv-cinder-85694 Sep 13 01:23:33.864009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-9a0e3b0e-d108-4a32-980e-074be6da1163 req-76c4256d-2c89-4bf9-80db-51bdc489b153 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046146 Sep 13 01:23:33.864932 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 330/647] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:23:33.891382 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f76e4ec5-9124-4a06-a86f-535f80dbeb60 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:33.903189 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f76e4ec5-9124-4a06-a86f-535f80dbeb60 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1362 microversion: 2.1 time: 0.307067 Sep 13 01:23:33.905273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 318/648] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:33 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1362 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:33.994345 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0f64683d-6723-49a3-b046-501553300eb2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:33.995168 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0f64683d-6723-49a3-b046-501553300eb2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:34.002769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0f64683d-6723-49a3-b046-501553300eb2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:34.003653 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0f64683d-6723-49a3-b046-501553300eb2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:34.004242 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0f64683d-6723-49a3-b046-501553300eb2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:34.005279 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0f64683d-6723-49a3-b046-501553300eb2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:34.006067 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0f64683d-6723-49a3-b046-501553300eb2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:34.006636 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0f64683d-6723-49a3-b046-501553300eb2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:34.268553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0f64683d-6723-49a3-b046-501553300eb2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:34.278555 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0f64683d-6723-49a3-b046-501553300eb2 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1574 microversion: 2.1 time: 0.289865 Sep 13 01:23:34.279606 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 331/649] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:33 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1574 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:34.927688 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-73242435-60c8-497f-84af-58f480190dc9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:34.928358 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-73242435-60c8-497f-84af-58f480190dc9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:34.935660 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-73242435-60c8-497f-84af-58f480190dc9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:34.936720 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-73242435-60c8-497f-84af-58f480190dc9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:34.936720 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-73242435-60c8-497f-84af-58f480190dc9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:34.937253 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-73242435-60c8-497f-84af-58f480190dc9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:34.937698 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-73242435-60c8-497f-84af-58f480190dc9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:34.938115 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-73242435-60c8-497f-84af-58f480190dc9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:35.067805 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-73242435-60c8-497f-84af-58f480190dc9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:35.075981 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-73242435-60c8-497f-84af-58f480190dc9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1362 microversion: 2.1 time: 0.152281 Sep 13 01:23:35.076562 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 319/650] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:34 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:35.301879 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-947e16af-617b-4910-bc22-0a387d37cf24 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:35.302688 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-947e16af-617b-4910-bc22-0a387d37cf24 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:35.310715 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-947e16af-617b-4910-bc22-0a387d37cf24 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:35.311230 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-947e16af-617b-4910-bc22-0a387d37cf24 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:35.311667 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-947e16af-617b-4910-bc22-0a387d37cf24 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:35.312358 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-947e16af-617b-4910-bc22-0a387d37cf24 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:35.312806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-947e16af-617b-4910-bc22-0a387d37cf24 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:35.313221 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-947e16af-617b-4910-bc22-0a387d37cf24 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:35.626611 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-947e16af-617b-4910-bc22-0a387d37cf24 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:35.634344 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-947e16af-617b-4910-bc22-0a387d37cf24 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1574 microversion: 2.1 time: 0.336186 Sep 13 01:23:35.635130 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 332/651] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:35 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1574 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:36.017020 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-6cfae57e-5e9f-491b-b1db-88c7da8bfb56 req-d398fcbe-484e-4ff9-b009-7aa8ea1370e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf5279a7-4859-458b-958c-85fd71cb4d72", "name": "network-vif-unplugged", "status": "completed", "tag": "c4858902-df62-4017-b106-503915275745"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:36.036193 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-6cfae57e-5e9f-491b-b1db-88c7da8bfb56 req-d398fcbe-484e-4ff9-b009-7aa8ea1370e1 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:36.036678 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-6cfae57e-5e9f-491b-b1db-88c7da8bfb56 req-d398fcbe-484e-4ff9-b009-7aa8ea1370e1 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:36.037324 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-6cfae57e-5e9f-491b-b1db-88c7da8bfb56 req-d398fcbe-484e-4ff9-b009-7aa8ea1370e1 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:36.049273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-6cfae57e-5e9f-491b-b1db-88c7da8bfb56 req-d398fcbe-484e-4ff9-b009-7aa8ea1370e1 service nova] Creating event network-vif-unplugged:c4858902-df62-4017-b106-503915275745 for instance cf5279a7-4859-458b-958c-85fd71cb4d72 on hv-cinder-85694 Sep 13 01:23:36.055012 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-6cfae57e-5e9f-491b-b1db-88c7da8bfb56 req-d398fcbe-484e-4ff9-b009-7aa8ea1370e1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.041437 Sep 13 01:23:36.055845 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 320/652] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:36.098741 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6b62ec88-bbac-4fe7-bc43-94ac5fa9461f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:36.099657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6b62ec88-bbac-4fe7-bc43-94ac5fa9461f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:36.106663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b62ec88-bbac-4fe7-bc43-94ac5fa9461f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:36.107175 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b62ec88-bbac-4fe7-bc43-94ac5fa9461f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:36.107607 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b62ec88-bbac-4fe7-bc43-94ac5fa9461f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:36.108308 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b62ec88-bbac-4fe7-bc43-94ac5fa9461f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:36.108895 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b62ec88-bbac-4fe7-bc43-94ac5fa9461f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:36.109324 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b62ec88-bbac-4fe7-bc43-94ac5fa9461f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:36.303623 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6b62ec88-bbac-4fe7-bc43-94ac5fa9461f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:36.306127 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:36.312887 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6b62ec88-bbac-4fe7-bc43-94ac5fa9461f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1548 microversion: 2.1 time: 0.218261 Sep 13 01:23:36.313484 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 333/653] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:36 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1548 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:36.335816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-22b150cc-f844-411b-91e6-1dd6e6d02e42 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:36.336457 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-22b150cc-f844-411b-91e6-1dd6e6d02e42 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:36.343131 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-22b150cc-f844-411b-91e6-1dd6e6d02e42 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:36.343609 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-22b150cc-f844-411b-91e6-1dd6e6d02e42 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:36.344038 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-22b150cc-f844-411b-91e6-1dd6e6d02e42 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:36.344734 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-22b150cc-f844-411b-91e6-1dd6e6d02e42 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:36.345181 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-22b150cc-f844-411b-91e6-1dd6e6d02e42 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:36.345598 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-22b150cc-f844-411b-91e6-1dd6e6d02e42 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:36.555277 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-22b150cc-f844-411b-91e6-1dd6e6d02e42 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.223854 Sep 13 01:23:36.556174 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 321/654] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 01:23:36 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-interface => generated 285 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:23:36.660803 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-eb6da897-db09-428b-9d8f-7aa943adc886 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:36.661492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-eb6da897-db09-428b-9d8f-7aa943adc886 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:36.672233 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb6da897-db09-428b-9d8f-7aa943adc886 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:36.672668 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb6da897-db09-428b-9d8f-7aa943adc886 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:36.673344 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb6da897-db09-428b-9d8f-7aa943adc886 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:36.675208 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb6da897-db09-428b-9d8f-7aa943adc886 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:36.675676 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb6da897-db09-428b-9d8f-7aa943adc886 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:36.676106 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb6da897-db09-428b-9d8f-7aa943adc886 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:36.914094 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-eb6da897-db09-428b-9d8f-7aa943adc886 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:36.924616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-eb6da897-db09-428b-9d8f-7aa943adc886 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1574 microversion: 2.1 time: 0.268869 Sep 13 01:23:36.925526 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 334/655] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:36 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1574 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:37.631234 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-d4a9dfff-5b91-4c37-83df-a1f1a877c693 req-66bec632-9c20-415c-806b-54504d517c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ad33c0aa-a0d0-423b-a979-7e448b85cf2a", "tag": "6a0f0882-0ddc-43dd-a35a-31a905ab84e6"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:37.647033 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-d4a9dfff-5b91-4c37-83df-a1f1a877c693 req-66bec632-9c20-415c-806b-54504d517c81 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:37.647801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-d4a9dfff-5b91-4c37-83df-a1f1a877c693 req-66bec632-9c20-415c-806b-54504d517c81 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:37.648423 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-d4a9dfff-5b91-4c37-83df-a1f1a877c693 req-66bec632-9c20-415c-806b-54504d517c81 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:37.662550 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-d4a9dfff-5b91-4c37-83df-a1f1a877c693 req-66bec632-9c20-415c-806b-54504d517c81 service nova] Creating event network-changed:6a0f0882-0ddc-43dd-a35a-31a905ab84e6 for instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a on hv-cinder-85694 Sep 13 01:23:37.668308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-d4a9dfff-5b91-4c37-83df-a1f1a877c693 req-66bec632-9c20-415c-806b-54504d517c81 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042181 Sep 13 01:23:37.669353 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 322/656] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:37.936524 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e770bb52-daa8-45fc-bcde-b36bb3d05ed6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:37.937557 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e770bb52-daa8-45fc-bcde-b36bb3d05ed6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:37.951484 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e770bb52-daa8-45fc-bcde-b36bb3d05ed6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:37.952264 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e770bb52-daa8-45fc-bcde-b36bb3d05ed6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:37.952893 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e770bb52-daa8-45fc-bcde-b36bb3d05ed6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:37.953772 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e770bb52-daa8-45fc-bcde-b36bb3d05ed6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:37.954337 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-138f5c5a-611a-4d6d-83db-532b26c0b2cc tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:37.954558 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e770bb52-daa8-45fc-bcde-b36bb3d05ed6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:37.955099 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-138f5c5a-611a-4d6d-83db-532b26c0b2cc tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:37.956213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e770bb52-daa8-45fc-bcde-b36bb3d05ed6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:37.971898 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-138f5c5a-611a-4d6d-83db-532b26c0b2cc tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:37.972393 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-138f5c5a-611a-4d6d-83db-532b26c0b2cc tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:37.972833 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-138f5c5a-611a-4d6d-83db-532b26c0b2cc tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:37.973542 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-138f5c5a-611a-4d6d-83db-532b26c0b2cc tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:37.973997 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-138f5c5a-611a-4d6d-83db-532b26c0b2cc tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:37.974421 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-138f5c5a-611a-4d6d-83db-532b26c0b2cc tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:37.989926 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e770bb52-daa8-45fc-bcde-b36bb3d05ed6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:23:38.119827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e770bb52-daa8-45fc-bcde-b36bb3d05ed6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 204 len: 0 microversion: 2.1 time: 0.193635 Sep 13 01:23:38.121852 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 335/657] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:23:37 2022] DELETE /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 0 bytes in 196 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:23:38.141117 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4de20cda-a8b7-4b4f-b3e4-ab569d7148e7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:38.142277 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4de20cda-a8b7-4b4f-b3e4-ab569d7148e7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:38.149842 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4de20cda-a8b7-4b4f-b3e4-ab569d7148e7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:38.150636 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4de20cda-a8b7-4b4f-b3e4-ab569d7148e7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:38.151315 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4de20cda-a8b7-4b4f-b3e4-ab569d7148e7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:38.152323 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4de20cda-a8b7-4b4f-b3e4-ab569d7148e7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:38.153000 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4de20cda-a8b7-4b4f-b3e4-ab569d7148e7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:38.153603 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4de20cda-a8b7-4b4f-b3e4-ab569d7148e7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:38.235220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-138f5c5a-611a-4d6d-83db-532b26c0b2cc tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:38.243337 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-138f5c5a-611a-4d6d-83db-532b26c0b2cc tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1574 microversion: 2.1 time: 0.297382 Sep 13 01:23:38.259474 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 323/658] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:37 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1574 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:38.466996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4de20cda-a8b7-4b4f-b3e4-ab569d7148e7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:38.475160 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4de20cda-a8b7-4b4f-b3e4-ab569d7148e7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1578 microversion: 2.1 time: 0.348713 Sep 13 01:23:38.476239 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 336/659] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:38 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1578 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:39.268716 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-16d211ad-2239-451e-ace3-d04ad691291b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:39.270089 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-16d211ad-2239-451e-ace3-d04ad691291b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:39.277350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-16d211ad-2239-451e-ace3-d04ad691291b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:39.278066 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-16d211ad-2239-451e-ace3-d04ad691291b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:39.278496 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-16d211ad-2239-451e-ace3-d04ad691291b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:39.279651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-16d211ad-2239-451e-ace3-d04ad691291b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:39.280192 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-16d211ad-2239-451e-ace3-d04ad691291b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:39.280621 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-16d211ad-2239-451e-ace3-d04ad691291b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:39.500117 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a5331a93-41fa-4e9a-8344-3ecfc8bc067b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:39.500625 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a5331a93-41fa-4e9a-8344-3ecfc8bc067b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:39.501439 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-16d211ad-2239-451e-ace3-d04ad691291b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:39.508571 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5331a93-41fa-4e9a-8344-3ecfc8bc067b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:39.509065 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5331a93-41fa-4e9a-8344-3ecfc8bc067b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:39.509353 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-16d211ad-2239-451e-ace3-d04ad691291b tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1574 microversion: 2.1 time: 0.245496 Sep 13 01:23:39.509691 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5331a93-41fa-4e9a-8344-3ecfc8bc067b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:39.515399 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 324/660] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:39 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1574 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:39.515552 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5331a93-41fa-4e9a-8344-3ecfc8bc067b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:39.515552 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5331a93-41fa-4e9a-8344-3ecfc8bc067b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:39.515552 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a5331a93-41fa-4e9a-8344-3ecfc8bc067b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:39.671336 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a5331a93-41fa-4e9a-8344-3ecfc8bc067b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:39.679240 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a5331a93-41fa-4e9a-8344-3ecfc8bc067b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1578 microversion: 2.1 time: 0.183741 Sep 13 01:23:39.679825 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 337/661] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:39 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1578 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:39.946739 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-bcb8da5e-7975-4bdd-b8bc-8d32fc7128bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:39.947865 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-bcb8da5e-7975-4bdd-b8bc-8d32fc7128bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:39.953522 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bcb8da5e-7975-4bdd-b8bc-8d32fc7128bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:39.954358 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bcb8da5e-7975-4bdd-b8bc-8d32fc7128bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:39.954937 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bcb8da5e-7975-4bdd-b8bc-8d32fc7128bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:39.956032 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bcb8da5e-7975-4bdd-b8bc-8d32fc7128bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:39.956703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bcb8da5e-7975-4bdd-b8bc-8d32fc7128bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:39.957338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bcb8da5e-7975-4bdd-b8bc-8d32fc7128bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:39.985772 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-bcb8da5e-7975-4bdd-b8bc-8d32fc7128bd tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/ips" status: 200 len: 151 microversion: 2.20 time: 0.040080 Sep 13 01:23:39.989677 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 325/662] 10.222.0.15 () {60 vars in 1289 bytes} [Tue Sep 13 01:23:39 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/ips => generated 151 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:23:40.538957 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f37f49f9-ad51-41cc-877a-21bf41603c9c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:40.539575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f37f49f9-ad51-41cc-877a-21bf41603c9c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:40.546427 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f37f49f9-ad51-41cc-877a-21bf41603c9c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:40.546765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f37f49f9-ad51-41cc-877a-21bf41603c9c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:40.547290 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f37f49f9-ad51-41cc-877a-21bf41603c9c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:40.548533 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f37f49f9-ad51-41cc-877a-21bf41603c9c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:40.548998 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f37f49f9-ad51-41cc-877a-21bf41603c9c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:40.549478 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f37f49f9-ad51-41cc-877a-21bf41603c9c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:40.709918 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-601756b6-c458-4036-9894-15acfcf2797c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:40.711461 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-601756b6-c458-4036-9894-15acfcf2797c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:40.716104 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f37f49f9-ad51-41cc-877a-21bf41603c9c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:40.721386 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-601756b6-c458-4036-9894-15acfcf2797c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:40.722091 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-601756b6-c458-4036-9894-15acfcf2797c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:40.722936 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-601756b6-c458-4036-9894-15acfcf2797c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:40.724012 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-601756b6-c458-4036-9894-15acfcf2797c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:40.724670 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-601756b6-c458-4036-9894-15acfcf2797c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:40.724962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f37f49f9-ad51-41cc-877a-21bf41603c9c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1574 microversion: 2.1 time: 0.191315 Sep 13 01:23:40.725505 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-601756b6-c458-4036-9894-15acfcf2797c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:40.725871 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 338/663] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:40 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:40.873226 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-601756b6-c458-4036-9894-15acfcf2797c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:40.883997 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-601756b6-c458-4036-9894-15acfcf2797c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1511 microversion: 2.1 time: 0.182005 Sep 13 01:23:40.899568 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 326/664] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:40 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1511 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:41.085197 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-e926406c-3b9e-4384-b736-55a50f73d043 req-a38ee627-c0d1-40b2-b9e1-309d55a1ca50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8555c188-5c8f-4a84-877b-c97fe0265c5c", "name": "network-vif-deleted", "tag": "6c6841ec-d12a-4293-a896-c6083998f37f"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:41.103551 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-e926406c-3b9e-4384-b736-55a50f73d043 req-a38ee627-c0d1-40b2-b9e1-309d55a1ca50 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:41.103885 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-e926406c-3b9e-4384-b736-55a50f73d043 req-a38ee627-c0d1-40b2-b9e1-309d55a1ca50 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:41.104328 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-e926406c-3b9e-4384-b736-55a50f73d043 req-a38ee627-c0d1-40b2-b9e1-309d55a1ca50 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:41.121638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-e926406c-3b9e-4384-b736-55a50f73d043 req-a38ee627-c0d1-40b2-b9e1-309d55a1ca50 service nova] Creating event network-vif-deleted:6c6841ec-d12a-4293-a896-c6083998f37f for instance 8555c188-5c8f-4a84-877b-c97fe0265c5c on hv-cinder-85694 Sep 13 01:23:41.127618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-e926406c-3b9e-4384-b736-55a50f73d043 req-a38ee627-c0d1-40b2-b9e1-309d55a1ca50 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046269 Sep 13 01:23:41.128638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 339/665] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:41.749771 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-fa1ad2d9-26bc-4639-9cfb-90e605b03d72 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:41.751041 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-fa1ad2d9-26bc-4639-9cfb-90e605b03d72 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:41.758393 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fa1ad2d9-26bc-4639-9cfb-90e605b03d72 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:41.758879 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fa1ad2d9-26bc-4639-9cfb-90e605b03d72 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:41.759469 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fa1ad2d9-26bc-4639-9cfb-90e605b03d72 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:41.760333 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fa1ad2d9-26bc-4639-9cfb-90e605b03d72 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:41.760784 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fa1ad2d9-26bc-4639-9cfb-90e605b03d72 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:41.761367 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fa1ad2d9-26bc-4639-9cfb-90e605b03d72 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:41.911379 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:41.913215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:41.915049 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-fa1ad2d9-26bc-4639-9cfb-90e605b03d72 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:41.924631 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-fa1ad2d9-26bc-4639-9cfb-90e605b03d72 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1574 microversion: 2.1 time: 0.179856 Sep 13 01:23:41.925720 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:41.926022 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 327/666] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:41 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1574 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:41.926435 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:41.927128 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:41.927961 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:41.928421 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:41.928972 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:41.966635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:41.967627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:41.968265 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:41.968910 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lazy-loading 'fault' on Instance uuid 8555c188-5c8f-4a84-877b-c97fe0265c5c {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:23:42.014806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:42.023550 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8930ca84-3041-4e59-a097-0de7916edbae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1230 microversion: 2.1 time: 0.119105 Sep 13 01:23:42.024135 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 340/667] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:41 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1230 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:42.131576 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f7f76597-3a3b-419e-8c33-78b97d2bfa03 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:42.132113 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-f7f76597-3a3b-419e-8c33-78b97d2bfa03 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:42.138522 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f7f76597-3a3b-419e-8c33-78b97d2bfa03 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:42.139216 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f7f76597-3a3b-419e-8c33-78b97d2bfa03 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:42.139803 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f7f76597-3a3b-419e-8c33-78b97d2bfa03 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:42.140651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f7f76597-3a3b-419e-8c33-78b97d2bfa03 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:42.141254 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f7f76597-3a3b-419e-8c33-78b97d2bfa03 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:42.141938 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f7f76597-3a3b-419e-8c33-78b97d2bfa03 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:42.181599 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-f7f76597-3a3b-419e-8c33-78b97d2bfa03 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lazy-loading 'flavor' on Instance uuid 29d56cdc-0d80-4681-9384-b1df6e5a403d {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:23:42.388972 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f7f76597-3a3b-419e-8c33-78b97d2bfa03 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "POST /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/action" status: 202 len: 0 microversion: 2.20 time: 0.261065 Sep 13 01:23:42.389715 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 328/668] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Sep 13 01:23:42 2022] POST /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:23:42.398609 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7bf7de08-21e7-44a7-a85b-9d274e62a05c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:42.399249 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7bf7de08-21e7-44a7-a85b-9d274e62a05c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:42.406745 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7bf7de08-21e7-44a7-a85b-9d274e62a05c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:42.407266 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7bf7de08-21e7-44a7-a85b-9d274e62a05c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:42.407704 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7bf7de08-21e7-44a7-a85b-9d274e62a05c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:42.408403 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7bf7de08-21e7-44a7-a85b-9d274e62a05c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:42.408853 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7bf7de08-21e7-44a7-a85b-9d274e62a05c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:42.409271 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7bf7de08-21e7-44a7-a85b-9d274e62a05c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:42.553635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7bf7de08-21e7-44a7-a85b-9d274e62a05c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:42.562004 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7bf7de08-21e7-44a7-a85b-9d274e62a05c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:42.563718 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7bf7de08-21e7-44a7-a85b-9d274e62a05c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:42.565153 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7bf7de08-21e7-44a7-a85b-9d274e62a05c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.171279 Sep 13 01:23:42.566269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 341/669] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:42 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:23:42.950496 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-48fe386f-08f5-4a7f-b758-2ccf2b94bb05 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:42.951220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-48fe386f-08f5-4a7f-b758-2ccf2b94bb05 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:42.957379 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48fe386f-08f5-4a7f-b758-2ccf2b94bb05 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:42.957859 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48fe386f-08f5-4a7f-b758-2ccf2b94bb05 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:42.958309 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48fe386f-08f5-4a7f-b758-2ccf2b94bb05 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:42.959007 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48fe386f-08f5-4a7f-b758-2ccf2b94bb05 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:42.959468 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48fe386f-08f5-4a7f-b758-2ccf2b94bb05 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:42.959889 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48fe386f-08f5-4a7f-b758-2ccf2b94bb05 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:43.051321 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:43.051967 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:43.060496 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:43.061173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:43.061800 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:43.062516 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:43.063006 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:43.063969 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:43.100046 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-48fe386f-08f5-4a7f-b758-2ccf2b94bb05 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:43.103486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:43.104239 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:43.105641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:43.106338 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lazy-loading 'fault' on Instance uuid 8555c188-5c8f-4a84-877b-c97fe0265c5c {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:23:43.111875 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-48fe386f-08f5-4a7f-b758-2ccf2b94bb05 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1561 microversion: 2.1 time: 0.166676 Sep 13 01:23:43.112517 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 329/670] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:42 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1561 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:43.155126 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:43.162065 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6b46e583-b39c-4b27-8f6c-eef7c485c39e tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 200 len: 1184 microversion: 2.1 time: 0.114580 Sep 13 01:23:43.162627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 342/671] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:43 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 1184 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:43.595473 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d3942ccd-0d2b-4d51-891d-2adb7da40180 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:43.596101 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d3942ccd-0d2b-4d51-891d-2adb7da40180 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:43.604598 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d3942ccd-0d2b-4d51-891d-2adb7da40180 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:43.605334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d3942ccd-0d2b-4d51-891d-2adb7da40180 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:43.605759 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d3942ccd-0d2b-4d51-891d-2adb7da40180 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:43.606493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d3942ccd-0d2b-4d51-891d-2adb7da40180 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:43.607016 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d3942ccd-0d2b-4d51-891d-2adb7da40180 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:43.607618 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d3942ccd-0d2b-4d51-891d-2adb7da40180 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:43.751466 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d3942ccd-0d2b-4d51-891d-2adb7da40180 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:43.759734 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d3942ccd-0d2b-4d51-891d-2adb7da40180 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:43.761850 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d3942ccd-0d2b-4d51-891d-2adb7da40180 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:43.763021 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d3942ccd-0d2b-4d51-891d-2adb7da40180 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.172397 Sep 13 01:23:43.763582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 330/672] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:43 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:23:44.185275 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2aa341dc-e1ec-46b6-bac7-e2eb6a088afc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:44.185898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2aa341dc-e1ec-46b6-bac7-e2eb6a088afc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:44.192275 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2aa341dc-e1ec-46b6-bac7-e2eb6a088afc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:44.192755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2aa341dc-e1ec-46b6-bac7-e2eb6a088afc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:44.193181 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2aa341dc-e1ec-46b6-bac7-e2eb6a088afc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:44.193861 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2aa341dc-e1ec-46b6-bac7-e2eb6a088afc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:44.194308 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2aa341dc-e1ec-46b6-bac7-e2eb6a088afc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:44.194721 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2aa341dc-e1ec-46b6-bac7-e2eb6a088afc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:44.207609 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-2aa341dc-e1ec-46b6-bac7-e2eb6a088afc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] HTTP exception thrown: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2aa341dc-e1ec-46b6-bac7-e2eb6a088afc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Request method failure captured: Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c HTTP/1.1 Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9rUf8JghhfO2JSuF4NmbKpLH7rIR3LCCeuIZBor8zAtI3fZiVe4BZ1a2fiBJtOj9Wdhbr_709vQkeJB6Cjx0psCjHnBu3C-BJeO8em2S61kObWLH8mUDyCoDJV7tMjCliMEAUCq_jr1i4NrR19gjZ-KSh11gbCX6Ea8dpXn6NDyc3k Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 66cdd4ec03ea4fbf959ede65bb96f6ca Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-TestVolumeBootPattern-921936311 Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:23:44.209201 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:23:44.210763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}] Sep 13 01:23:44.210763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-TestVolumeBootPattern-921936311 Sep 13 01:23:44.210763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 66cdd4ec03ea4fbf959ede65bb96f6ca Sep 13 01:23:44.210763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-TestVolumeBootPattern-921936311 Sep 13 01:23:44.210763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-TestVolumeBootPattern-921936311-project Sep 13 01:23:44.210763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:23:44.210763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:23:44.210763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 2842b222fe6b4821a670d13ec8febf1a Sep 13 01:23:44.210763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-TestVolumeBootPattern-921936311-project Sep 13 01:23:44.210763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:23:44.210763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:23:44.210763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '8555c188-5c8f-4a84-877b-c97fe0265c5c'} Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:23:44.211638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:23:44.212947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:23:44.214514 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2aa341dc-e1ec-46b6-bac7-e2eb6a088afc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Returning 404 to user: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:23:44.214514 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2aa341dc-e1ec-46b6-bac7-e2eb6a088afc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 404 len: 111 microversion: 2.1 time: 0.030110 Sep 13 01:23:44.214514 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 343/673] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:44 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:23:44.307692 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1437238686", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1305807284", "security_groups": [{"name": "tempest-secgroup-smoke-161750292"}], "block_device_mapping_v2": [{"uuid": "72d1500a-0d12-4501-80d2-3b3910e31b8e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0a90ed41-eeae-4dbf-a9a3-4da26905e9e8"}]}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:44.418630 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.network.neutron [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] validate_networks() for [('0a90ed41-eeae-4dbf-a9a3-4da26905e9e8', None, None, None, None, None)] {{(pid=120412) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:23:44.784049 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Flavor limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:23:44.784596 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Image limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:23:44.785178 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Flavor pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:23:44.785694 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Image pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:23:44.786345 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:23:44.788041 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6520ec71-bad3-4cc0-878e-900512f0fb91 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:44.788660 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6520ec71-bad3-4cc0-878e-900512f0fb91 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:44.795125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6520ec71-bad3-4cc0-878e-900512f0fb91 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:44.795608 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6520ec71-bad3-4cc0-878e-900512f0fb91 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:44.795941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:44.796375 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6520ec71-bad3-4cc0-878e-900512f0fb91 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:44.796503 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:44.796877 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:44.797053 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6520ec71-bad3-4cc0-878e-900512f0fb91 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:44.797608 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:44.797748 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6520ec71-bad3-4cc0-878e-900512f0fb91 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:44.798068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:44.798202 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6520ec71-bad3-4cc0-878e-900512f0fb91 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:44.798624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:44.816575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Getting quotas for project 66cdd4ec03ea4fbf959ede65bb96f6ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:23:44.820941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Getting quotas for user 2842b222fe6b4821a670d13ec8febf1a and project 66cdd4ec03ea4fbf959ede65bb96f6ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:23:44.881742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Going to run 1 instances... {{(pid=120412) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:23:44.883957 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='72d1500a-0d12-4501-80d2-3b3910e31b8e',volume_size=None,volume_type=None)] {{(pid=120412) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:23:44.953594 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6520ec71-bad3-4cc0-878e-900512f0fb91 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:44.962376 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6520ec71-bad3-4cc0-878e-900512f0fb91 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:44.969946 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6520ec71-bad3-4cc0-878e-900512f0fb91 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:44.971344 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6520ec71-bad3-4cc0-878e-900512f0fb91 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.187167 Sep 13 01:23:44.971899 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 344/674] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:44 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:23:45.033136 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-76eab419-daa8-4022-a7aa-56e2124d6023 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.729465 Sep 13 01:23:45.033791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 331/675] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:23:44 2022] POST /compute/v2.1/servers => generated 405 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 01:23:45.044814 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-25483328-bfaf-435d-9197-db08ea899c5b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:45.045459 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-25483328-bfaf-435d-9197-db08ea899c5b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:45.099230 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-25483328-bfaf-435d-9197-db08ea899c5b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:45.106125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-25483328-bfaf-435d-9197-db08ea899c5b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1095 microversion: 2.1 time: 0.065205 Sep 13 01:23:45.106773 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 345/676] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:45 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:45.997030 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c7bcfec1-87fa-4614-8d1b-7b8862c15e5b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:45.997637 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c7bcfec1-87fa-4614-8d1b-7b8862c15e5b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:46.003572 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c7bcfec1-87fa-4614-8d1b-7b8862c15e5b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:46.004052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c7bcfec1-87fa-4614-8d1b-7b8862c15e5b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:46.004487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c7bcfec1-87fa-4614-8d1b-7b8862c15e5b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:46.005171 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c7bcfec1-87fa-4614-8d1b-7b8862c15e5b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:46.005621 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c7bcfec1-87fa-4614-8d1b-7b8862c15e5b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:46.006041 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c7bcfec1-87fa-4614-8d1b-7b8862c15e5b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:46.129077 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a538035e-d06e-4949-bcc5-4a2e183aad20 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:46.129678 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a538035e-d06e-4949-bcc5-4a2e183aad20 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:46.134333 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c7bcfec1-87fa-4614-8d1b-7b8862c15e5b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:46.136052 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a538035e-d06e-4949-bcc5-4a2e183aad20 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:46.136723 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a538035e-d06e-4949-bcc5-4a2e183aad20 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:46.137664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a538035e-d06e-4949-bcc5-4a2e183aad20 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:46.138367 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a538035e-d06e-4949-bcc5-4a2e183aad20 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:46.138818 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a538035e-d06e-4949-bcc5-4a2e183aad20 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:46.139264 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a538035e-d06e-4949-bcc5-4a2e183aad20 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:46.143259 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c7bcfec1-87fa-4614-8d1b-7b8862c15e5b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:46.144746 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c7bcfec1-87fa-4614-8d1b-7b8862c15e5b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:46.145938 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c7bcfec1-87fa-4614-8d1b-7b8862c15e5b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.153273 Sep 13 01:23:46.146494 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 332/677] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:45 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:23:46.203297 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a538035e-d06e-4949-bcc5-4a2e183aad20 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:46.210918 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a538035e-d06e-4949-bcc5-4a2e183aad20 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1145 microversion: 2.1 time: 0.085760 Sep 13 01:23:46.211480 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 346/678] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:46 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:46.946573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-4c5ed47b-9d96-4550-a2eb-fa607cbee072 req-ff60c81f-13f0-422a-8c2f-042eac2c184f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf5279a7-4859-458b-958c-85fd71cb4d72", "name": "network-vif-plugged", "status": "completed", "tag": "c4858902-df62-4017-b106-503915275745"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:46.956252 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-4c5ed47b-9d96-4550-a2eb-fa607cbee072 req-ff60c81f-13f0-422a-8c2f-042eac2c184f service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:46.956766 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-4c5ed47b-9d96-4550-a2eb-fa607cbee072 req-ff60c81f-13f0-422a-8c2f-042eac2c184f service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:46.957258 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-4c5ed47b-9d96-4550-a2eb-fa607cbee072 req-ff60c81f-13f0-422a-8c2f-042eac2c184f service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:46.968900 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-4c5ed47b-9d96-4550-a2eb-fa607cbee072 req-ff60c81f-13f0-422a-8c2f-042eac2c184f service nova] Creating event network-vif-plugged:c4858902-df62-4017-b106-503915275745 for instance cf5279a7-4859-458b-958c-85fd71cb4d72 on hv-cinder-85694 Sep 13 01:23:46.973889 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-4c5ed47b-9d96-4550-a2eb-fa607cbee072 req-ff60c81f-13f0-422a-8c2f-042eac2c184f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031077 Sep 13 01:23:46.974633 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 333/679] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:47.172069 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cf3be793-ccc8-4f3f-96f0-c44124045220 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:47.172599 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cf3be793-ccc8-4f3f-96f0-c44124045220 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:47.179023 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cf3be793-ccc8-4f3f-96f0-c44124045220 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:47.179507 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cf3be793-ccc8-4f3f-96f0-c44124045220 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:47.179939 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cf3be793-ccc8-4f3f-96f0-c44124045220 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:47.180629 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cf3be793-ccc8-4f3f-96f0-c44124045220 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:47.181082 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cf3be793-ccc8-4f3f-96f0-c44124045220 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:47.181507 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cf3be793-ccc8-4f3f-96f0-c44124045220 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:47.235277 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e260f6fb-7a99-46fc-abcb-2df6399e2fbc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:47.236004 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-e260f6fb-7a99-46fc-abcb-2df6399e2fbc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:47.242056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e260f6fb-7a99-46fc-abcb-2df6399e2fbc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:47.242541 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e260f6fb-7a99-46fc-abcb-2df6399e2fbc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:47.243004 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e260f6fb-7a99-46fc-abcb-2df6399e2fbc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:47.243694 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e260f6fb-7a99-46fc-abcb-2df6399e2fbc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:47.244145 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e260f6fb-7a99-46fc-abcb-2df6399e2fbc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:47.244566 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e260f6fb-7a99-46fc-abcb-2df6399e2fbc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:47.259152 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:47.308745 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-e260f6fb-7a99-46fc-abcb-2df6399e2fbc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:47.310136 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cf3be793-ccc8-4f3f-96f0-c44124045220 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:47.316906 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-e260f6fb-7a99-46fc-abcb-2df6399e2fbc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1145 microversion: 2.1 time: 0.086998 Sep 13 01:23:47.317485 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 334/680] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:47 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:23:47.318233 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cf3be793-ccc8-4f3f-96f0-c44124045220 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:47.319699 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cf3be793-ccc8-4f3f-96f0-c44124045220 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:47.320850 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cf3be793-ccc8-4f3f-96f0-c44124045220 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.153229 Sep 13 01:23:47.321392 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 347/681] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:47 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:23:48.339307 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-50826c9a-8d1f-4c19-92e7-028a8a9137dc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:48.339960 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-50826c9a-8d1f-4c19-92e7-028a8a9137dc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:48.346620 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5317b16b-9573-40e9-b2d6-d2d4a0aa8367 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:48.347094 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-50826c9a-8d1f-4c19-92e7-028a8a9137dc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:48.347424 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-50826c9a-8d1f-4c19-92e7-028a8a9137dc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:48.347540 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5317b16b-9573-40e9-b2d6-d2d4a0aa8367 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:48.347862 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-50826c9a-8d1f-4c19-92e7-028a8a9137dc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:48.348562 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-50826c9a-8d1f-4c19-92e7-028a8a9137dc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:48.349019 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-50826c9a-8d1f-4c19-92e7-028a8a9137dc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:48.349440 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-50826c9a-8d1f-4c19-92e7-028a8a9137dc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:48.354875 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5317b16b-9573-40e9-b2d6-d2d4a0aa8367 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:48.355959 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5317b16b-9573-40e9-b2d6-d2d4a0aa8367 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:48.356484 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5317b16b-9573-40e9-b2d6-d2d4a0aa8367 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:48.357268 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5317b16b-9573-40e9-b2d6-d2d4a0aa8367 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:48.357828 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5317b16b-9573-40e9-b2d6-d2d4a0aa8367 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:48.358326 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5317b16b-9573-40e9-b2d6-d2d4a0aa8367 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:48.418508 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-50826c9a-8d1f-4c19-92e7-028a8a9137dc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:48.427672 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-50826c9a-8d1f-4c19-92e7-028a8a9137dc tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1193 microversion: 2.1 time: 0.092031 Sep 13 01:23:48.428255 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 335/682] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:48 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1193 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:48.524379 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5317b16b-9573-40e9-b2d6-d2d4a0aa8367 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:48.541143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5317b16b-9573-40e9-b2d6-d2d4a0aa8367 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:48.549147 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5317b16b-9573-40e9-b2d6-d2d4a0aa8367 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:48.552550 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5317b16b-9573-40e9-b2d6-d2d4a0aa8367 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.210860 Sep 13 01:23:48.575570 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 348/683] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:48 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:23:49.453465 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-fe6ee9e8-712e-4e92-bbc5-ca2276adc151 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:49.454159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-fe6ee9e8-712e-4e92-bbc5-ca2276adc151 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:49.460242 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fe6ee9e8-712e-4e92-bbc5-ca2276adc151 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:49.460756 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fe6ee9e8-712e-4e92-bbc5-ca2276adc151 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:49.461191 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fe6ee9e8-712e-4e92-bbc5-ca2276adc151 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:49.461878 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fe6ee9e8-712e-4e92-bbc5-ca2276adc151 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:49.462332 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fe6ee9e8-712e-4e92-bbc5-ca2276adc151 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:49.462753 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fe6ee9e8-712e-4e92-bbc5-ca2276adc151 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:49.583607 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e72d353d-ae05-4ba5-a1ec-380de8a1ebba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:49.584342 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e72d353d-ae05-4ba5-a1ec-380de8a1ebba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:49.591341 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e72d353d-ae05-4ba5-a1ec-380de8a1ebba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:49.597083 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e72d353d-ae05-4ba5-a1ec-380de8a1ebba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:49.597487 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e72d353d-ae05-4ba5-a1ec-380de8a1ebba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:49.598209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e72d353d-ae05-4ba5-a1ec-380de8a1ebba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:49.598836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e72d353d-ae05-4ba5-a1ec-380de8a1ebba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:49.599292 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e72d353d-ae05-4ba5-a1ec-380de8a1ebba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:49.706708 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-fe6ee9e8-712e-4e92-bbc5-ca2276adc151 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:49.714001 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-fe6ee9e8-712e-4e92-bbc5-ca2276adc151 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1266 microversion: 2.1 time: 0.263898 Sep 13 01:23:49.728036 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 336/684] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:49 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1266 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:49.758521 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e72d353d-ae05-4ba5-a1ec-380de8a1ebba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:49.767731 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e72d353d-ae05-4ba5-a1ec-380de8a1ebba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:49.769164 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e72d353d-ae05-4ba5-a1ec-380de8a1ebba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:49.770328 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e72d353d-ae05-4ba5-a1ec-380de8a1ebba tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.190598 Sep 13 01:23:49.770917 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 349/685] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:49 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:23:50.143973 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-f22f40e7-dc7d-4307-95c3-ee644e074871 req-9473c488-3a72-4937-b0b9-29c072ff13d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfba6992-16f5-4e5a-b9d4-975bdf6f8e81", "tag": "4195c70c-e59e-4802-a081-867a4bbc8d9f"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:50.153548 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-f22f40e7-dc7d-4307-95c3-ee644e074871 req-9473c488-3a72-4937-b0b9-29c072ff13d1 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:50.154037 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-f22f40e7-dc7d-4307-95c3-ee644e074871 req-9473c488-3a72-4937-b0b9-29c072ff13d1 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:50.154472 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-f22f40e7-dc7d-4307-95c3-ee644e074871 req-9473c488-3a72-4937-b0b9-29c072ff13d1 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:50.167388 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-f22f40e7-dc7d-4307-95c3-ee644e074871 req-9473c488-3a72-4937-b0b9-29c072ff13d1 service nova] Creating event network-changed:4195c70c-e59e-4802-a081-867a4bbc8d9f for instance bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 on hv-cinder-85694 Sep 13 01:23:50.172567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-f22f40e7-dc7d-4307-95c3-ee644e074871 req-9473c488-3a72-4937-b0b9-29c072ff13d1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032441 Sep 13 01:23:50.173551 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 337/686] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:50.738667 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6c7aefbf-af3f-4c70-9ba2-ef3011ab2e90 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:50.739308 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6c7aefbf-af3f-4c70-9ba2-ef3011ab2e90 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:50.745637 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c7aefbf-af3f-4c70-9ba2-ef3011ab2e90 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:50.746123 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c7aefbf-af3f-4c70-9ba2-ef3011ab2e90 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:50.746557 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c7aefbf-af3f-4c70-9ba2-ef3011ab2e90 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:50.747276 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c7aefbf-af3f-4c70-9ba2-ef3011ab2e90 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:50.747725 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c7aefbf-af3f-4c70-9ba2-ef3011ab2e90 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:50.748162 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c7aefbf-af3f-4c70-9ba2-ef3011ab2e90 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:50.763228 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:50.796055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0baf86cd-3dc5-4708-836d-7585063d4f5f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:50.796758 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0baf86cd-3dc5-4708-836d-7585063d4f5f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:50.802776 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0baf86cd-3dc5-4708-836d-7585063d4f5f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:50.803292 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0baf86cd-3dc5-4708-836d-7585063d4f5f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:50.803758 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0baf86cd-3dc5-4708-836d-7585063d4f5f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:50.804459 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0baf86cd-3dc5-4708-836d-7585063d4f5f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:50.805011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0baf86cd-3dc5-4708-836d-7585063d4f5f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:50.805436 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0baf86cd-3dc5-4708-836d-7585063d4f5f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:50.882790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6c7aefbf-af3f-4c70-9ba2-ef3011ab2e90 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:50.891012 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6c7aefbf-af3f-4c70-9ba2-ef3011ab2e90 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1266 microversion: 2.1 time: 0.156099 Sep 13 01:23:50.891589 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 350/687] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:50 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:51.021366 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0baf86cd-3dc5-4708-836d-7585063d4f5f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:51.030556 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0baf86cd-3dc5-4708-836d-7585063d4f5f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:51.032027 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0baf86cd-3dc5-4708-836d-7585063d4f5f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:51.033830 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0baf86cd-3dc5-4708-836d-7585063d4f5f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.242563 Sep 13 01:23:51.046283 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 338/688] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:50 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:23:51.913337 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b7dabe5b-62c4-4a2b-b44b-5d0d509c67ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:51.914069 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b7dabe5b-62c4-4a2b-b44b-5d0d509c67ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:51.920824 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b7dabe5b-62c4-4a2b-b44b-5d0d509c67ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:51.921374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b7dabe5b-62c4-4a2b-b44b-5d0d509c67ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:51.921853 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b7dabe5b-62c4-4a2b-b44b-5d0d509c67ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:51.922655 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b7dabe5b-62c4-4a2b-b44b-5d0d509c67ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:51.923137 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b7dabe5b-62c4-4a2b-b44b-5d0d509c67ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:51.923566 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b7dabe5b-62c4-4a2b-b44b-5d0d509c67ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:52.065061 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-6d825b69-54dc-401d-b29e-fd14f497669c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:52.066420 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-6d825b69-54dc-401d-b29e-fd14f497669c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:52.073465 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6d825b69-54dc-401d-b29e-fd14f497669c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:52.073924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b7dabe5b-62c4-4a2b-b44b-5d0d509c67ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:52.074167 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6d825b69-54dc-401d-b29e-fd14f497669c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:52.075156 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6d825b69-54dc-401d-b29e-fd14f497669c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:52.075950 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6d825b69-54dc-401d-b29e-fd14f497669c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:52.076476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6d825b69-54dc-401d-b29e-fd14f497669c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:52.076932 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6d825b69-54dc-401d-b29e-fd14f497669c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:52.090142 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b7dabe5b-62c4-4a2b-b44b-5d0d509c67ae tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1266 microversion: 2.1 time: 0.180952 Sep 13 01:23:52.091140 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 351/689] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:51 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:52.232689 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6d825b69-54dc-401d-b29e-fd14f497669c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:52.240887 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6d825b69-54dc-401d-b29e-fd14f497669c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:52.242629 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6d825b69-54dc-401d-b29e-fd14f497669c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:52.243835 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-6d825b69-54dc-401d-b29e-fd14f497669c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.186254 Sep 13 01:23:52.244394 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 339/690] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:52 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:23:53.115510 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-de0f056c-b3da-48b1-9362-c4e3f0779749 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:53.116202 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-de0f056c-b3da-48b1-9362-c4e3f0779749 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:53.118719 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:53.124906 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de0f056c-b3da-48b1-9362-c4e3f0779749 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:53.124906 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de0f056c-b3da-48b1-9362-c4e3f0779749 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:53.124906 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de0f056c-b3da-48b1-9362-c4e3f0779749 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:53.125465 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de0f056c-b3da-48b1-9362-c4e3f0779749 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:53.126001 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de0f056c-b3da-48b1-9362-c4e3f0779749 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:53.126399 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-de0f056c-b3da-48b1-9362-c4e3f0779749 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:53.265261 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-de0f056c-b3da-48b1-9362-c4e3f0779749 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:53.273737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-de0f056c-b3da-48b1-9362-c4e3f0779749 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1266 microversion: 2.1 time: 0.162080 Sep 13 01:23:53.274413 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 352/691] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:53 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:53.521250 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b942b743-1eea-46a5-b8a3-dfc3355ff7ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:53.521868 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b942b743-1eea-46a5-b8a3-dfc3355ff7ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:53.527736 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b942b743-1eea-46a5-b8a3-dfc3355ff7ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:53.528218 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b942b743-1eea-46a5-b8a3-dfc3355ff7ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:53.528653 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b942b743-1eea-46a5-b8a3-dfc3355ff7ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:53.529342 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b942b743-1eea-46a5-b8a3-dfc3355ff7ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:53.529789 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b942b743-1eea-46a5-b8a3-dfc3355ff7ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:53.530211 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b942b743-1eea-46a5-b8a3-dfc3355ff7ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:53.663709 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b942b743-1eea-46a5-b8a3-dfc3355ff7ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:53.672264 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b942b743-1eea-46a5-b8a3-dfc3355ff7ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:53.673687 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b942b743-1eea-46a5-b8a3-dfc3355ff7ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:53.674885 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b942b743-1eea-46a5-b8a3-dfc3355ff7ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.409614 Sep 13 01:23:53.675609 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 340/692] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:53 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:23:54.295353 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-37fa89a0-4c07-40de-9f1f-da96ccb8763c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:54.295990 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-37fa89a0-4c07-40de-9f1f-da96ccb8763c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:54.302582 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37fa89a0-4c07-40de-9f1f-da96ccb8763c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:54.303113 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37fa89a0-4c07-40de-9f1f-da96ccb8763c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:54.303548 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37fa89a0-4c07-40de-9f1f-da96ccb8763c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:54.304234 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37fa89a0-4c07-40de-9f1f-da96ccb8763c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:54.304681 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37fa89a0-4c07-40de-9f1f-da96ccb8763c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:54.305117 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37fa89a0-4c07-40de-9f1f-da96ccb8763c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:54.445076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-37fa89a0-4c07-40de-9f1f-da96ccb8763c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:54.453190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-37fa89a0-4c07-40de-9f1f-da96ccb8763c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1266 microversion: 2.1 time: 0.161564 Sep 13 01:23:54.453753 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 353/693] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:54 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:54.700310 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b9bff0fa-55c1-4583-8e5d-75787660e157 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:54.700925 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b9bff0fa-55c1-4583-8e5d-75787660e157 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:54.707311 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b9bff0fa-55c1-4583-8e5d-75787660e157 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:54.707799 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b9bff0fa-55c1-4583-8e5d-75787660e157 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:54.708234 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b9bff0fa-55c1-4583-8e5d-75787660e157 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:54.708929 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b9bff0fa-55c1-4583-8e5d-75787660e157 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:54.709382 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b9bff0fa-55c1-4583-8e5d-75787660e157 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:54.710024 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b9bff0fa-55c1-4583-8e5d-75787660e157 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:54.807740 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:54.827892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=6 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:54.845738 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b9bff0fa-55c1-4583-8e5d-75787660e157 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:54.854487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b9bff0fa-55c1-4583-8e5d-75787660e157 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:54.857015 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b9bff0fa-55c1-4583-8e5d-75787660e157 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:54.858514 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b9bff0fa-55c1-4583-8e5d-75787660e157 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.161842 Sep 13 01:23:54.859282 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 341/694] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:54 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:23:55.475616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-42e7916e-8bed-4ea8-8113-b0c7020a0b2b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:55.476301 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-42e7916e-8bed-4ea8-8113-b0c7020a0b2b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:55.478242 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:55.484791 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42e7916e-8bed-4ea8-8113-b0c7020a0b2b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:55.485307 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42e7916e-8bed-4ea8-8113-b0c7020a0b2b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:55.485750 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42e7916e-8bed-4ea8-8113-b0c7020a0b2b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:55.486504 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42e7916e-8bed-4ea8-8113-b0c7020a0b2b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:55.487023 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42e7916e-8bed-4ea8-8113-b0c7020a0b2b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:55.487452 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-42e7916e-8bed-4ea8-8113-b0c7020a0b2b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:55.630781 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-42e7916e-8bed-4ea8-8113-b0c7020a0b2b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:55.638562 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-42e7916e-8bed-4ea8-8113-b0c7020a0b2b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1266 microversion: 2.1 time: 0.167028 Sep 13 01:23:55.639163 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 354/695] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:55 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:55.883835 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-51f44b23-da80-4067-879d-9652448ac864 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:55.884615 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-51f44b23-da80-4067-879d-9652448ac864 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:55.892937 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-51f44b23-da80-4067-879d-9652448ac864 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:55.893543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-51f44b23-da80-4067-879d-9652448ac864 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:55.893990 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-51f44b23-da80-4067-879d-9652448ac864 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:55.895250 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-51f44b23-da80-4067-879d-9652448ac864 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:55.895850 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-51f44b23-da80-4067-879d-9652448ac864 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:55.896276 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-51f44b23-da80-4067-879d-9652448ac864 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:56.033326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-51f44b23-da80-4067-879d-9652448ac864 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:56.041479 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-51f44b23-da80-4067-879d-9652448ac864 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:56.043735 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-51f44b23-da80-4067-879d-9652448ac864 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:56.045703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-51f44b23-da80-4067-879d-9652448ac864 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.166080 Sep 13 01:23:56.046280 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 342/696] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:55 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:23:56.451070 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1c77df84-e09d-4aea-8ab8-358dd227566f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:56.451586 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1c77df84-e09d-4aea-8ab8-358dd227566f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:56.457448 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c77df84-e09d-4aea-8ab8-358dd227566f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:56.457920 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c77df84-e09d-4aea-8ab8-358dd227566f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:56.458346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c77df84-e09d-4aea-8ab8-358dd227566f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:56.459053 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c77df84-e09d-4aea-8ab8-358dd227566f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:56.459671 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c77df84-e09d-4aea-8ab8-358dd227566f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:56.460095 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1c77df84-e09d-4aea-8ab8-358dd227566f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:56.484142 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1c77df84-e09d-4aea-8ab8-358dd227566f tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/ips" status: 200 len: 150 microversion: 2.1 time: 0.036866 Sep 13 01:23:56.484757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 355/697] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 01:23:56 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:23:56.663341 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3834b9e9-982f-49d6-a588-a7733c978fc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:56.664656 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3834b9e9-982f-49d6-a588-a7733c978fc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:56.673175 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3834b9e9-982f-49d6-a588-a7733c978fc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:56.673748 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3834b9e9-982f-49d6-a588-a7733c978fc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:56.675352 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3834b9e9-982f-49d6-a588-a7733c978fc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:56.675956 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3834b9e9-982f-49d6-a588-a7733c978fc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:56.676545 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3834b9e9-982f-49d6-a588-a7733c978fc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:56.676960 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3834b9e9-982f-49d6-a588-a7733c978fc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:56.825540 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3834b9e9-982f-49d6-a588-a7733c978fc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:56.834594 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3834b9e9-982f-49d6-a588-a7733c978fc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1266 microversion: 2.1 time: 0.176553 Sep 13 01:23:56.835302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 343/698] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:56 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:57.071240 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b831bb99-9f66-423c-ad37-7a72b6240238 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:57.071844 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b831bb99-9f66-423c-ad37-7a72b6240238 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:57.078913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b831bb99-9f66-423c-ad37-7a72b6240238 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:57.079394 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b831bb99-9f66-423c-ad37-7a72b6240238 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:57.079826 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b831bb99-9f66-423c-ad37-7a72b6240238 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:57.080509 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b831bb99-9f66-423c-ad37-7a72b6240238 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:57.080951 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b831bb99-9f66-423c-ad37-7a72b6240238 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:57.081369 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b831bb99-9f66-423c-ad37-7a72b6240238 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:57.219453 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b831bb99-9f66-423c-ad37-7a72b6240238 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:57.227715 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b831bb99-9f66-423c-ad37-7a72b6240238 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:57.229156 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b831bb99-9f66-423c-ad37-7a72b6240238 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:57.230382 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b831bb99-9f66-423c-ad37-7a72b6240238 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.162948 Sep 13 01:23:57.231184 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 356/699] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:57 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:23:57.848736 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e9f20b24-b0af-4811-82b6-2f911e8b8348 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ded6d6c0-2e99-41be-9aa6-73ade6c14054"}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:57.851832 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-e9f20b24-b0af-4811-82b6-2f911e8b8348 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:57.860048 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e9f20b24-b0af-4811-82b6-2f911e8b8348 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:57.860887 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e9f20b24-b0af-4811-82b6-2f911e8b8348 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:57.861499 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e9f20b24-b0af-4811-82b6-2f911e8b8348 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:57.862396 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e9f20b24-b0af-4811-82b6-2f911e8b8348 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:57.863188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e9f20b24-b0af-4811-82b6-2f911e8b8348 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:57.863624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e9f20b24-b0af-4811-82b6-2f911e8b8348 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:57.864250 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1a2075c6-a374-4251-a1d7-f03203903b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:57.866598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1a2075c6-a374-4251-a1d7-f03203903b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:57.874233 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a2075c6-a374-4251-a1d7-f03203903b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:57.874997 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a2075c6-a374-4251-a1d7-f03203903b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:57.875988 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a2075c6-a374-4251-a1d7-f03203903b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:57.876927 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a2075c6-a374-4251-a1d7-f03203903b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:57.877457 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a2075c6-a374-4251-a1d7-f03203903b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:57.878078 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a2075c6-a374-4251-a1d7-f03203903b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:58.042770 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1a2075c6-a374-4251-a1d7-f03203903b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:58.053933 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1a2075c6-a374-4251-a1d7-f03203903b01 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1266 microversion: 2.1 time: 0.199644 Sep 13 01:23:58.067328 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 357/700] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:57 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1266 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:58.206122 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-e9f20b24-b0af-4811-82b6-2f911e8b8348 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "POST /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.360958 Sep 13 01:23:58.206736 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 344/701] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:23:57 2022] POST /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/os-volume_attachments => generated 194 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:23:58.267062 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cb4eb9e9-9156-49c6-a8ac-e1a668fec2bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:58.267062 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cb4eb9e9-9156-49c6-a8ac-e1a668fec2bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:58.267062 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cb4eb9e9-9156-49c6-a8ac-e1a668fec2bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:58.267062 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cb4eb9e9-9156-49c6-a8ac-e1a668fec2bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:58.267544 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cb4eb9e9-9156-49c6-a8ac-e1a668fec2bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:58.267544 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cb4eb9e9-9156-49c6-a8ac-e1a668fec2bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:58.267544 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cb4eb9e9-9156-49c6-a8ac-e1a668fec2bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:58.267544 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cb4eb9e9-9156-49c6-a8ac-e1a668fec2bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:58.393551 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cb4eb9e9-9156-49c6-a8ac-e1a668fec2bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:58.402942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cb4eb9e9-9156-49c6-a8ac-e1a668fec2bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:58.404701 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cb4eb9e9-9156-49c6-a8ac-e1a668fec2bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:58.406102 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cb4eb9e9-9156-49c6-a8ac-e1a668fec2bc tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.154118 Sep 13 01:23:58.406763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 358/702] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:58 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:23:59.079784 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5b833841-e727-4209-af3b-be909fd6fe0f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:59.080619 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-5b833841-e727-4209-af3b-be909fd6fe0f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:59.082998 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:23:59.088420 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5b833841-e727-4209-af3b-be909fd6fe0f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:59.088911 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5b833841-e727-4209-af3b-be909fd6fe0f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:59.089330 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5b833841-e727-4209-af3b-be909fd6fe0f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:59.090023 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5b833841-e727-4209-af3b-be909fd6fe0f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:59.090474 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5b833841-e727-4209-af3b-be909fd6fe0f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:59.091067 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5b833841-e727-4209-af3b-be909fd6fe0f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:59.233319 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5b833841-e727-4209-af3b-be909fd6fe0f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:59.240959 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-5b833841-e727-4209-af3b-be909fd6fe0f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1266 microversion: 2.1 time: 0.165449 Sep 13 01:23:59.241536 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 345/703] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:23:59 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:23:59.432029 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-eb699186-f48b-4d78-abd7-e066b7636f46 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:23:59.433585 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-eb699186-f48b-4d78-abd7-e066b7636f46 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:23:59.439760 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb699186-f48b-4d78-abd7-e066b7636f46 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:59.440241 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb699186-f48b-4d78-abd7-e066b7636f46 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:59.440667 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb699186-f48b-4d78-abd7-e066b7636f46 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:59.441352 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb699186-f48b-4d78-abd7-e066b7636f46 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:59.441799 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb699186-f48b-4d78-abd7-e066b7636f46 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:59.442218 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eb699186-f48b-4d78-abd7-e066b7636f46 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:59.584650 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-eb699186-f48b-4d78-abd7-e066b7636f46 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:59.592656 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-eb699186-f48b-4d78-abd7-e066b7636f46 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:59.594076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-eb699186-f48b-4d78-abd7-e066b7636f46 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:23:59.595253 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-eb699186-f48b-4d78-abd7-e066b7636f46 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.167130 Sep 13 01:23:59.595825 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 359/704] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:23:59 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:23:59.967751 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-952ab29a-58a5-45b2-a68a-a0de5ecac2e7 req-937c8eb0-99d5-4e23-8d83-75fa7d8fcff0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfba6992-16f5-4e5a-b9d4-975bdf6f8e81", "name": "network-vif-plugged", "status": "completed", "tag": "4195c70c-e59e-4802-a081-867a4bbc8d9f"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:23:59.977761 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-952ab29a-58a5-45b2-a68a-a0de5ecac2e7 req-937c8eb0-99d5-4e23-8d83-75fa7d8fcff0 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:23:59.978235 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-952ab29a-58a5-45b2-a68a-a0de5ecac2e7 req-937c8eb0-99d5-4e23-8d83-75fa7d8fcff0 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:23:59.978663 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-952ab29a-58a5-45b2-a68a-a0de5ecac2e7 req-937c8eb0-99d5-4e23-8d83-75fa7d8fcff0 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:23:59.990134 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-952ab29a-58a5-45b2-a68a-a0de5ecac2e7 req-937c8eb0-99d5-4e23-8d83-75fa7d8fcff0 service nova] Creating event network-vif-plugged:4195c70c-e59e-4802-a081-867a4bbc8d9f for instance bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 on hv-cinder-85694 Sep 13 01:23:59.994750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-952ab29a-58a5-45b2-a68a-a0de5ecac2e7 req-937c8eb0-99d5-4e23-8d83-75fa7d8fcff0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031191 Sep 13 01:23:59.995565 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 346/705] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:00.270054 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5e6fbb72-35de-478d-ac25-ae42c38bedda tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:00.270666 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5e6fbb72-35de-478d-ac25-ae42c38bedda tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:00.276596 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e6fbb72-35de-478d-ac25-ae42c38bedda tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:00.277577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e6fbb72-35de-478d-ac25-ae42c38bedda tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:00.278014 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e6fbb72-35de-478d-ac25-ae42c38bedda tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:00.278711 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e6fbb72-35de-478d-ac25-ae42c38bedda tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:00.279193 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e6fbb72-35de-478d-ac25-ae42c38bedda tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:00.279663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5e6fbb72-35de-478d-ac25-ae42c38bedda tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:00.415286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5e6fbb72-35de-478d-ac25-ae42c38bedda tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:00.424509 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5e6fbb72-35de-478d-ac25-ae42c38bedda tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1266 microversion: 2.1 time: 0.158034 Sep 13 01:24:00.425498 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 360/706] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:00 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:00.621536 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-195520dd-8c1e-45d0-8dfb-bd4d98ede721 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:00.622264 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-195520dd-8c1e-45d0-8dfb-bd4d98ede721 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:00.628448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-195520dd-8c1e-45d0-8dfb-bd4d98ede721 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:00.628931 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-195520dd-8c1e-45d0-8dfb-bd4d98ede721 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:00.629365 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-195520dd-8c1e-45d0-8dfb-bd4d98ede721 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:00.630056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-195520dd-8c1e-45d0-8dfb-bd4d98ede721 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:00.630506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-195520dd-8c1e-45d0-8dfb-bd4d98ede721 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:00.630953 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-195520dd-8c1e-45d0-8dfb-bd4d98ede721 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:00.764907 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-195520dd-8c1e-45d0-8dfb-bd4d98ede721 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:00.773744 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-195520dd-8c1e-45d0-8dfb-bd4d98ede721 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:00.775329 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-195520dd-8c1e-45d0-8dfb-bd4d98ede721 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:00.776618 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-195520dd-8c1e-45d0-8dfb-bd4d98ede721 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.159739 Sep 13 01:24:00.787002 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 347/707] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:00 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:01.449738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-aebf1501-d1a5-4c16-8fc2-afea057fc47d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:01.450892 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-aebf1501-d1a5-4c16-8fc2-afea057fc47d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:01.457578 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aebf1501-d1a5-4c16-8fc2-afea057fc47d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:01.458057 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aebf1501-d1a5-4c16-8fc2-afea057fc47d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:01.458490 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aebf1501-d1a5-4c16-8fc2-afea057fc47d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:01.459198 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aebf1501-d1a5-4c16-8fc2-afea057fc47d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:01.459673 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aebf1501-d1a5-4c16-8fc2-afea057fc47d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:01.460089 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-aebf1501-d1a5-4c16-8fc2-afea057fc47d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:01.619048 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-aebf1501-d1a5-4c16-8fc2-afea057fc47d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:01.626622 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-aebf1501-d1a5-4c16-8fc2-afea057fc47d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1266 microversion: 2.1 time: 0.181027 Sep 13 01:24:01.627659 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 361/708] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:01 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:01.802666 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b865e14c-f355-404e-a44c-4945fe567a8e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:01.804000 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b865e14c-f355-404e-a44c-4945fe567a8e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:01.811772 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b865e14c-f355-404e-a44c-4945fe567a8e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:01.812530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b865e14c-f355-404e-a44c-4945fe567a8e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:01.813491 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b865e14c-f355-404e-a44c-4945fe567a8e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:01.815135 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b865e14c-f355-404e-a44c-4945fe567a8e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:01.815498 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b865e14c-f355-404e-a44c-4945fe567a8e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:01.816144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b865e14c-f355-404e-a44c-4945fe567a8e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:01.960362 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b865e14c-f355-404e-a44c-4945fe567a8e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:01.971831 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b865e14c-f355-404e-a44c-4945fe567a8e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:01.973649 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b865e14c-f355-404e-a44c-4945fe567a8e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:01.975090 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b865e14c-f355-404e-a44c-4945fe567a8e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.176318 Sep 13 01:24:01.977199 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 348/709] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:01 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:02.649027 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1d37b642-5002-4413-be94-5442afcb371a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:02.649642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1d37b642-5002-4413-be94-5442afcb371a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:02.656505 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d37b642-5002-4413-be94-5442afcb371a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:02.656998 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d37b642-5002-4413-be94-5442afcb371a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:02.657440 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d37b642-5002-4413-be94-5442afcb371a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:02.658303 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d37b642-5002-4413-be94-5442afcb371a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:02.658841 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d37b642-5002-4413-be94-5442afcb371a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:02.659433 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d37b642-5002-4413-be94-5442afcb371a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:02.794020 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1d37b642-5002-4413-be94-5442afcb371a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:02.801924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1d37b642-5002-4413-be94-5442afcb371a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1453 microversion: 2.1 time: 0.156690 Sep 13 01:24:02.802710 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 362/710] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:02 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:02.824346 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f8b7e591-4c18-472d-ad8a-b072f4bf3725 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:02.824954 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-f8b7e591-4c18-472d-ad8a-b072f4bf3725 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:02.831393 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f8b7e591-4c18-472d-ad8a-b072f4bf3725 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:02.831878 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f8b7e591-4c18-472d-ad8a-b072f4bf3725 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:02.832311 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f8b7e591-4c18-472d-ad8a-b072f4bf3725 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:02.833001 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f8b7e591-4c18-472d-ad8a-b072f4bf3725 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:02.833624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f8b7e591-4c18-472d-ad8a-b072f4bf3725 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:02.834048 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f8b7e591-4c18-472d-ad8a-b072f4bf3725 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:02.978621 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f8b7e591-4c18-472d-ad8a-b072f4bf3725 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:02.986190 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f8b7e591-4c18-472d-ad8a-b072f4bf3725 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1453 microversion: 2.1 time: 0.166202 Sep 13 01:24:02.986756 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 349/711] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:02 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1453 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:03.002225 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-071cf7a3-3ca1-4a3b-bb80-81c6238a00a4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:03.003295 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-071cf7a3-3ca1-4a3b-bb80-81c6238a00a4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:03.009308 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-071cf7a3-3ca1-4a3b-bb80-81c6238a00a4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:03.009850 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-071cf7a3-3ca1-4a3b-bb80-81c6238a00a4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:03.010294 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-071cf7a3-3ca1-4a3b-bb80-81c6238a00a4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:03.011558 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-071cf7a3-3ca1-4a3b-bb80-81c6238a00a4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:03.012016 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-071cf7a3-3ca1-4a3b-bb80-81c6238a00a4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:03.012535 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-071cf7a3-3ca1-4a3b-bb80-81c6238a00a4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:03.152893 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-071cf7a3-3ca1-4a3b-bb80-81c6238a00a4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:03.162976 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-071cf7a3-3ca1-4a3b-bb80-81c6238a00a4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:03.164432 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-071cf7a3-3ca1-4a3b-bb80-81c6238a00a4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:03.165625 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-071cf7a3-3ca1-4a3b-bb80-81c6238a00a4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.167411 Sep 13 01:24:03.166184 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 363/712] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:02 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:24:04.190978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-eba43c6e-3577-4546-80b4-b929f64dcc32 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:04.191521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-eba43c6e-3577-4546-80b4-b929f64dcc32 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:04.198096 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-eba43c6e-3577-4546-80b4-b929f64dcc32 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:04.199125 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-eba43c6e-3577-4546-80b4-b929f64dcc32 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:04.199558 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-eba43c6e-3577-4546-80b4-b929f64dcc32 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:04.200247 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-eba43c6e-3577-4546-80b4-b929f64dcc32 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:04.200696 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-eba43c6e-3577-4546-80b4-b929f64dcc32 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:04.201113 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-eba43c6e-3577-4546-80b4-b929f64dcc32 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:04.523299 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-eba43c6e-3577-4546-80b4-b929f64dcc32 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:04.531913 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-eba43c6e-3577-4546-80b4-b929f64dcc32 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:04.535466 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-eba43c6e-3577-4546-80b4-b929f64dcc32 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:04.535466 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-eba43c6e-3577-4546-80b4-b929f64dcc32 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1743 microversion: 2.20 time: 0.347718 Sep 13 01:24:04.535644 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 350/713] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:04 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1743 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:24:05.076406 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-667242f4-15e5-4b8a-b4ac-a47a9e950ca2 req-7783bf27-15e0-48bb-a1a1-18a3c77bcfd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfba6992-16f5-4e5a-b9d4-975bdf6f8e81", "tag": "4195c70c-e59e-4802-a081-867a4bbc8d9f"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:05.087731 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-667242f4-15e5-4b8a-b4ac-a47a9e950ca2 req-7783bf27-15e0-48bb-a1a1-18a3c77bcfd8 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:05.088298 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-667242f4-15e5-4b8a-b4ac-a47a9e950ca2 req-7783bf27-15e0-48bb-a1a1-18a3c77bcfd8 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:05.088812 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-667242f4-15e5-4b8a-b4ac-a47a9e950ca2 req-7783bf27-15e0-48bb-a1a1-18a3c77bcfd8 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:05.102571 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-667242f4-15e5-4b8a-b4ac-a47a9e950ca2 req-7783bf27-15e0-48bb-a1a1-18a3c77bcfd8 service nova] Creating event network-changed:4195c70c-e59e-4802-a081-867a4bbc8d9f for instance bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 on hv-cinder-85694 Sep 13 01:24:05.108254 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-667242f4-15e5-4b8a-b4ac-a47a9e950ca2 req-7783bf27-15e0-48bb-a1a1-18a3c77bcfd8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035979 Sep 13 01:24:05.108920 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 364/714] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:05.570899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c806a82b-2f08-4012-aedd-9012923ca3b5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:05.574033 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c806a82b-2f08-4012-aedd-9012923ca3b5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:05.591970 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c806a82b-2f08-4012-aedd-9012923ca3b5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:05.594711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c806a82b-2f08-4012-aedd-9012923ca3b5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:05.596918 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c806a82b-2f08-4012-aedd-9012923ca3b5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:05.598877 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c806a82b-2f08-4012-aedd-9012923ca3b5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:05.600564 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c806a82b-2f08-4012-aedd-9012923ca3b5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:05.602237 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c806a82b-2f08-4012-aedd-9012923ca3b5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:05.629706 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:05.829838 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-faddcf9f-8e45-4447-8703-eeebef8f92ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ded6d6c0-2e99-41be-9aa6-73ade6c14054"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:05.832281 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-faddcf9f-8e45-4447-8703-eeebef8f92ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:05.862981 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faddcf9f-8e45-4447-8703-eeebef8f92ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:05.862981 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faddcf9f-8e45-4447-8703-eeebef8f92ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:05.862981 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faddcf9f-8e45-4447-8703-eeebef8f92ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:05.862981 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faddcf9f-8e45-4447-8703-eeebef8f92ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:05.864122 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faddcf9f-8e45-4447-8703-eeebef8f92ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:05.864122 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-faddcf9f-8e45-4447-8703-eeebef8f92ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:05.864277 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c806a82b-2f08-4012-aedd-9012923ca3b5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:05.865529 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c806a82b-2f08-4012-aedd-9012923ca3b5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:05.867611 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c806a82b-2f08-4012-aedd-9012923ca3b5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:05.869908 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c806a82b-2f08-4012-aedd-9012923ca3b5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1738 microversion: 2.20 time: 0.310056 Sep 13 01:24:05.871070 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 351/715] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:05 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1738 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:06.016129 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-faddcf9f-8e45-4447-8703-eeebef8f92ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Invalid volume: volume ded6d6c0-2e99-41be-9aa6-73ade6c14054 is already attached to instances: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-faddcf9f-8e45-4447-8703-eeebef8f92ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: POST /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/os-volume_attachments HTTP/1.1 Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 74 Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:24:06.018657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:24:06.020638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:24:06.020638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:24:06.020638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:24:06.020638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:24:06.020638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:24:06.020638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:24:06.020638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:24:06.020638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:24:06.020638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:24:06.020638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Sep 13 01:24:06.020638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {"volumeAttachment": {"volumeId": "ded6d6c0-2e99-41be-9aa6-73ade6c14054"}} Sep 13 01:24:06.020638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Invalid volume: volume ded6d6c0-2e99-41be-9aa6-73ade6c14054 is already attached to instances: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'server_id': '4334e1fb-8fd8-47e4-a1dd-fb08c0b83480', 'body': {'volumeAttachment': {'volumeId': 'ded6d6c0-2e99-41be-9aa6-73ade6c14054'}}} Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ded6d6c0-2e99-41be-9aa6-73ade6c14054 is already attached to instances: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:06.021626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ded6d6c0-2e99-41be-9aa6-73ade6c14054 is already attached to instances: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:24:06.022790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:24:06.024006 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:24:06.024006 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:24:06.024006 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:24:06.024006 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ded6d6c0-2e99-41be-9aa6-73ade6c14054 is already attached to instances: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 Sep 13 01:24:06.024006 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:06.026076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-faddcf9f-8e45-4447-8703-eeebef8f92ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 400 to user: Invalid volume: volume ded6d6c0-2e99-41be-9aa6-73ade6c14054 is already attached to instances: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:24:06.028295 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-faddcf9f-8e45-4447-8703-eeebef8f92ed tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "POST /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.203100 Sep 13 01:24:06.030090 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 365/716] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:24:05 2022] POST /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/os-volume_attachments => generated 174 bytes in 206 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 01:24:06.114254 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8f3d6f7c-4c1a-4e8e-84b7-648b9db9e4ee tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:06.115432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-8f3d6f7c-4c1a-4e8e-84b7-648b9db9e4ee tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:06.123725 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8f3d6f7c-4c1a-4e8e-84b7-648b9db9e4ee tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:06.124366 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8f3d6f7c-4c1a-4e8e-84b7-648b9db9e4ee tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:06.124875 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8f3d6f7c-4c1a-4e8e-84b7-648b9db9e4ee tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:06.125860 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8f3d6f7c-4c1a-4e8e-84b7-648b9db9e4ee tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:06.126748 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8f3d6f7c-4c1a-4e8e-84b7-648b9db9e4ee tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:06.127265 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8f3d6f7c-4c1a-4e8e-84b7-648b9db9e4ee tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:06.258438 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-8f3d6f7c-4c1a-4e8e-84b7-648b9db9e4ee tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lazy-loading 'services' on Instance uuid 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:24:06.356905 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-8f3d6f7c-4c1a-4e8e-84b7-648b9db9e4ee tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/os-volume_attachments/ded6d6c0-2e99-41be-9aa6-73ade6c14054" status: 202 len: 0 microversion: 2.1 time: 0.255260 Sep 13 01:24:06.357506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 352/717] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 01:24:06 2022] DELETE /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/os-volume_attachments/ded6d6c0-2e99-41be-9aa6-73ade6c14054 => generated 0 bytes in 257 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:24:06.373133 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-24569c51-9317-42a3-9a69-eb739fb85495 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:06.375374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-24569c51-9317-42a3-9a69-eb739fb85495 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:06.384876 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24569c51-9317-42a3-9a69-eb739fb85495 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:06.387709 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24569c51-9317-42a3-9a69-eb739fb85495 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:06.388278 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24569c51-9317-42a3-9a69-eb739fb85495 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:06.389175 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24569c51-9317-42a3-9a69-eb739fb85495 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:06.389694 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24569c51-9317-42a3-9a69-eb739fb85495 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:06.390144 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-24569c51-9317-42a3-9a69-eb739fb85495 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:06.452791 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-24569c51-9317-42a3-9a69-eb739fb85495 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088436 Sep 13 01:24:06.454566 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 366/718] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:24:06 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:06.903957 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a140664f-158c-46a5-b730-7c716a78571c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:06.904800 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a140664f-158c-46a5-b730-7c716a78571c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:06.911252 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a140664f-158c-46a5-b730-7c716a78571c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:06.912002 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a140664f-158c-46a5-b730-7c716a78571c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:06.912639 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a140664f-158c-46a5-b730-7c716a78571c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:06.913335 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a140664f-158c-46a5-b730-7c716a78571c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:06.913943 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a140664f-158c-46a5-b730-7c716a78571c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:06.914646 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a140664f-158c-46a5-b730-7c716a78571c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:07.087829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a140664f-158c-46a5-b730-7c716a78571c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:07.099066 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a140664f-158c-46a5-b730-7c716a78571c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:07.100775 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a140664f-158c-46a5-b730-7c716a78571c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:07.102024 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a140664f-158c-46a5-b730-7c716a78571c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1738 microversion: 2.20 time: 0.203087 Sep 13 01:24:07.102686 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 353/719] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:06 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1738 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:07.467315 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4ed6cfd9-3b3b-4d0d-aca0-106a92373f64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:07.469648 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4ed6cfd9-3b3b-4d0d-aca0-106a92373f64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:07.485281 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4ed6cfd9-3b3b-4d0d-aca0-106a92373f64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:07.485923 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4ed6cfd9-3b3b-4d0d-aca0-106a92373f64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:07.486483 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4ed6cfd9-3b3b-4d0d-aca0-106a92373f64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:07.487368 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4ed6cfd9-3b3b-4d0d-aca0-106a92373f64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:07.487903 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4ed6cfd9-3b3b-4d0d-aca0-106a92373f64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:07.488402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4ed6cfd9-3b3b-4d0d-aca0-106a92373f64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:07.531647 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4ed6cfd9-3b3b-4d0d-aca0-106a92373f64 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.068873 Sep 13 01:24:07.532429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 367/720] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:24:07 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480/os-volume_attachments => generated 25 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 01:24:07.599401 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7e6ad040-e368-48c2-be99-b84bdd4421b5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:07.600380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7e6ad040-e368-48c2-be99-b84bdd4421b5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:07.607140 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e6ad040-e368-48c2-be99-b84bdd4421b5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:07.607797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e6ad040-e368-48c2-be99-b84bdd4421b5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:07.608307 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e6ad040-e368-48c2-be99-b84bdd4421b5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:07.609162 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e6ad040-e368-48c2-be99-b84bdd4421b5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:07.609699 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e6ad040-e368-48c2-be99-b84bdd4421b5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:07.610318 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7e6ad040-e368-48c2-be99-b84bdd4421b5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:07.637256 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7e6ad040-e368-48c2-be99-b84bdd4421b5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Going to try to terminate instance {{(pid=120412) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:24:07.728885 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7e6ad040-e368-48c2-be99-b84bdd4421b5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 204 len: 0 microversion: 2.1 time: 0.133619 Sep 13 01:24:07.731015 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 354/721] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:24:07 2022] DELETE /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:24:07.740541 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9e5c81fe-daca-4bcd-960a-15602dab5092 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:07.741153 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9e5c81fe-daca-4bcd-960a-15602dab5092 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:07.748411 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e5c81fe-daca-4bcd-960a-15602dab5092 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:07.748972 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e5c81fe-daca-4bcd-960a-15602dab5092 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:07.749620 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e5c81fe-daca-4bcd-960a-15602dab5092 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:07.750323 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e5c81fe-daca-4bcd-960a-15602dab5092 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:07.750885 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e5c81fe-daca-4bcd-960a-15602dab5092 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:07.751397 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e5c81fe-daca-4bcd-960a-15602dab5092 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:07.756335 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:07.908735 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9e5c81fe-daca-4bcd-960a-15602dab5092 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:07.919053 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9e5c81fe-daca-4bcd-960a-15602dab5092 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1682 microversion: 2.1 time: 0.182555 Sep 13 01:24:07.919962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 368/722] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:07 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1682 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:08.035994 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-4ee984c0-acfb-4e84-b2a1-5f874a4f9aaa req-4cd0dbb3-9411-4228-8e44-386003b2085c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d56cdc-0d80-4681-9384-b1df6e5a403d", "name": "network-vif-plugged", "status": "completed", "tag": "7eba6092-8d78-465f-a5ad-642414710fd4"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:08.048155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-4ee984c0-acfb-4e84-b2a1-5f874a4f9aaa req-4cd0dbb3-9411-4228-8e44-386003b2085c service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:08.052301 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-4ee984c0-acfb-4e84-b2a1-5f874a4f9aaa req-4cd0dbb3-9411-4228-8e44-386003b2085c service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:08.053098 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-4ee984c0-acfb-4e84-b2a1-5f874a4f9aaa req-4cd0dbb3-9411-4228-8e44-386003b2085c service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:08.074261 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-4ee984c0-acfb-4e84-b2a1-5f874a4f9aaa req-4cd0dbb3-9411-4228-8e44-386003b2085c service nova] Creating event network-vif-plugged:7eba6092-8d78-465f-a5ad-642414710fd4 for instance 29d56cdc-0d80-4681-9384-b1df6e5a403d on hv-cinder-85694 Sep 13 01:24:08.079829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-4ee984c0-acfb-4e84-b2a1-5f874a4f9aaa req-4cd0dbb3-9411-4228-8e44-386003b2085c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047910 Sep 13 01:24:08.081024 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 355/723] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:08.137611 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c2ec71ca-7e8e-4615-ae99-f4f1293a8205 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:08.139733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c2ec71ca-7e8e-4615-ae99-f4f1293a8205 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:08.148927 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ec71ca-7e8e-4615-ae99-f4f1293a8205 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:08.149428 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ec71ca-7e8e-4615-ae99-f4f1293a8205 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:08.149859 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ec71ca-7e8e-4615-ae99-f4f1293a8205 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:08.154100 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ec71ca-7e8e-4615-ae99-f4f1293a8205 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:08.154663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ec71ca-7e8e-4615-ae99-f4f1293a8205 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:08.155271 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c2ec71ca-7e8e-4615-ae99-f4f1293a8205 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:08.343306 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c2ec71ca-7e8e-4615-ae99-f4f1293a8205 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:08.358241 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c2ec71ca-7e8e-4615-ae99-f4f1293a8205 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:08.361040 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c2ec71ca-7e8e-4615-ae99-f4f1293a8205 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:08.363047 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c2ec71ca-7e8e-4615-ae99-f4f1293a8205 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1738 microversion: 2.20 time: 0.230062 Sep 13 01:24:08.364173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 369/724] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:08 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1738 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:08.946037 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0a164d85-ff4c-4444-90fe-277c06a9ef37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:08.947148 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0a164d85-ff4c-4444-90fe-277c06a9ef37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:08.954034 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0a164d85-ff4c-4444-90fe-277c06a9ef37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:08.954820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0a164d85-ff4c-4444-90fe-277c06a9ef37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:08.955540 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0a164d85-ff4c-4444-90fe-277c06a9ef37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:08.956493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0a164d85-ff4c-4444-90fe-277c06a9ef37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:08.957084 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0a164d85-ff4c-4444-90fe-277c06a9ef37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:08.957574 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0a164d85-ff4c-4444-90fe-277c06a9ef37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:09.095632 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0a164d85-ff4c-4444-90fe-277c06a9ef37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:09.104143 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0a164d85-ff4c-4444-90fe-277c06a9ef37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1682 microversion: 2.1 time: 0.162258 Sep 13 01:24:09.105627 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 356/725] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:08 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:09.393673 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8baec78c-5e67-4b0c-bc02-5dbc3b6382ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:09.394261 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8baec78c-5e67-4b0c-bc02-5dbc3b6382ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:09.400878 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8baec78c-5e67-4b0c-bc02-5dbc3b6382ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:09.401389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8baec78c-5e67-4b0c-bc02-5dbc3b6382ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:09.401831 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8baec78c-5e67-4b0c-bc02-5dbc3b6382ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:09.402980 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8baec78c-5e67-4b0c-bc02-5dbc3b6382ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:09.402980 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8baec78c-5e67-4b0c-bc02-5dbc3b6382ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:09.407826 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8baec78c-5e67-4b0c-bc02-5dbc3b6382ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:09.555601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8baec78c-5e67-4b0c-bc02-5dbc3b6382ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:09.573510 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8baec78c-5e67-4b0c-bc02-5dbc3b6382ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:09.575304 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8baec78c-5e67-4b0c-bc02-5dbc3b6382ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:09.576543 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8baec78c-5e67-4b0c-bc02-5dbc3b6382ed tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1738 microversion: 2.20 time: 0.186761 Sep 13 01:24:09.577292 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 370/726] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:09 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:10.129139 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-492d9bf0-76db-4b7c-98ad-b717410e1d16 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:10.130380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-492d9bf0-76db-4b7c-98ad-b717410e1d16 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:10.137471 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-492d9bf0-76db-4b7c-98ad-b717410e1d16 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:10.137954 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-492d9bf0-76db-4b7c-98ad-b717410e1d16 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:10.138416 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-492d9bf0-76db-4b7c-98ad-b717410e1d16 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:10.139148 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-492d9bf0-76db-4b7c-98ad-b717410e1d16 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:10.139599 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-492d9bf0-76db-4b7c-98ad-b717410e1d16 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:10.140016 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-492d9bf0-76db-4b7c-98ad-b717410e1d16 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:10.279192 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-492d9bf0-76db-4b7c-98ad-b717410e1d16 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:10.287139 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-492d9bf0-76db-4b7c-98ad-b717410e1d16 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1682 microversion: 2.1 time: 0.162100 Sep 13 01:24:10.288187 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 357/727] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:10 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1682 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:10.605337 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-807b8f6a-27ff-493d-aa47-ad0d66409da2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:10.606267 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-807b8f6a-27ff-493d-aa47-ad0d66409da2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:10.613725 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-807b8f6a-27ff-493d-aa47-ad0d66409da2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:10.614445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-807b8f6a-27ff-493d-aa47-ad0d66409da2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:10.615095 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-807b8f6a-27ff-493d-aa47-ad0d66409da2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:10.616207 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-807b8f6a-27ff-493d-aa47-ad0d66409da2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:10.616915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-807b8f6a-27ff-493d-aa47-ad0d66409da2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:10.617476 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-807b8f6a-27ff-493d-aa47-ad0d66409da2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:10.757096 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-807b8f6a-27ff-493d-aa47-ad0d66409da2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:10.766421 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-807b8f6a-27ff-493d-aa47-ad0d66409da2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:10.768135 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-807b8f6a-27ff-493d-aa47-ad0d66409da2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:10.769331 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-807b8f6a-27ff-493d-aa47-ad0d66409da2 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1738 microversion: 2.20 time: 0.168007 Sep 13 01:24:10.782876 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 371/728] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:10 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1738 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:11.312006 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c48887ee-197f-4f85-8e38-2d91deda24f0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:11.313316 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c48887ee-197f-4f85-8e38-2d91deda24f0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:11.319826 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c48887ee-197f-4f85-8e38-2d91deda24f0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:11.320561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c48887ee-197f-4f85-8e38-2d91deda24f0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:11.321238 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c48887ee-197f-4f85-8e38-2d91deda24f0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:11.322177 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c48887ee-197f-4f85-8e38-2d91deda24f0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:11.322825 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c48887ee-197f-4f85-8e38-2d91deda24f0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:11.323981 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c48887ee-197f-4f85-8e38-2d91deda24f0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:11.471782 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c48887ee-197f-4f85-8e38-2d91deda24f0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:11.484670 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c48887ee-197f-4f85-8e38-2d91deda24f0 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1682 microversion: 2.1 time: 0.176973 Sep 13 01:24:11.485882 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 358/729] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:11 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1682 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:11.795819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9e969789-242f-4013-838d-a48305aaa390 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:11.796449 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9e969789-242f-4013-838d-a48305aaa390 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:11.803070 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e969789-242f-4013-838d-a48305aaa390 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:11.803559 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e969789-242f-4013-838d-a48305aaa390 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:11.804002 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e969789-242f-4013-838d-a48305aaa390 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:11.804715 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e969789-242f-4013-838d-a48305aaa390 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:11.805159 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e969789-242f-4013-838d-a48305aaa390 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:11.805582 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9e969789-242f-4013-838d-a48305aaa390 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:11.947812 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9e969789-242f-4013-838d-a48305aaa390 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:11.956882 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9e969789-242f-4013-838d-a48305aaa390 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:11.958459 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9e969789-242f-4013-838d-a48305aaa390 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:11.959708 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9e969789-242f-4013-838d-a48305aaa390 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1738 microversion: 2.20 time: 0.168432 Sep 13 01:24:11.960295 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 372/730] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:11 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1738 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:12.509508 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1017e44c-7371-4be5-9ccd-91c0d5338f1b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:12.510892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1017e44c-7371-4be5-9ccd-91c0d5338f1b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:12.518173 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1017e44c-7371-4be5-9ccd-91c0d5338f1b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:12.519156 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1017e44c-7371-4be5-9ccd-91c0d5338f1b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:12.520655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1017e44c-7371-4be5-9ccd-91c0d5338f1b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:12.521588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1017e44c-7371-4be5-9ccd-91c0d5338f1b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:12.522116 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1017e44c-7371-4be5-9ccd-91c0d5338f1b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:12.522602 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1017e44c-7371-4be5-9ccd-91c0d5338f1b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:12.644966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1017e44c-7371-4be5-9ccd-91c0d5338f1b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:12.653816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1017e44c-7371-4be5-9ccd-91c0d5338f1b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1614 microversion: 2.1 time: 0.148323 Sep 13 01:24:12.673997 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 359/731] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:12 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1614 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:12.986358 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ac35cef1-a61c-4999-abed-6e62bd34c71f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:12.988164 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ac35cef1-a61c-4999-abed-6e62bd34c71f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:12.995640 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac35cef1-a61c-4999-abed-6e62bd34c71f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:12.996487 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac35cef1-a61c-4999-abed-6e62bd34c71f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:12.997155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac35cef1-a61c-4999-abed-6e62bd34c71f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:12.998395 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac35cef1-a61c-4999-abed-6e62bd34c71f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:12.999406 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac35cef1-a61c-4999-abed-6e62bd34c71f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:13.000061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ac35cef1-a61c-4999-abed-6e62bd34c71f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:13.266456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ac35cef1-a61c-4999-abed-6e62bd34c71f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:13.267851 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-34dcfac7-5157-4c67-a674-afc9b05d2a54 req-b05a7002-4f60-439d-9648-8116356c30ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4334e1fb-8fd8-47e4-a1dd-fb08c0b83480", "name": "network-vif-deleted", "tag": "c89a2bf8-5d6d-499b-acf5-34318ae145ba"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:13.275351 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ac35cef1-a61c-4999-abed-6e62bd34c71f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:13.276851 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ac35cef1-a61c-4999-abed-6e62bd34c71f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:13.278234 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ac35cef1-a61c-4999-abed-6e62bd34c71f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1738 microversion: 2.20 time: 0.295722 Sep 13 01:24:13.280330 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 373/732] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:12 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1738 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:13.284544 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-34dcfac7-5157-4c67-a674-afc9b05d2a54 req-b05a7002-4f60-439d-9648-8116356c30ed service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:13.285085 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-34dcfac7-5157-4c67-a674-afc9b05d2a54 req-b05a7002-4f60-439d-9648-8116356c30ed service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:13.285570 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-34dcfac7-5157-4c67-a674-afc9b05d2a54 req-b05a7002-4f60-439d-9648-8116356c30ed service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:13.297839 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-34dcfac7-5157-4c67-a674-afc9b05d2a54 req-b05a7002-4f60-439d-9648-8116356c30ed service nova] Creating event network-vif-deleted:c89a2bf8-5d6d-499b-acf5-34318ae145ba for instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 on hv-cinder-85694 Sep 13 01:24:13.303010 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-34dcfac7-5157-4c67-a674-afc9b05d2a54 req-b05a7002-4f60-439d-9648-8116356c30ed service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041270 Sep 13 01:24:13.303903 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 360/733] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:24:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:24:13.679192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5df3affe-96be-4131-bbfb-50d49bb2bead tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:13.680596 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5df3affe-96be-4131-bbfb-50d49bb2bead tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:13.688381 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5df3affe-96be-4131-bbfb-50d49bb2bead tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:13.689248 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5df3affe-96be-4131-bbfb-50d49bb2bead tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:13.690896 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5df3affe-96be-4131-bbfb-50d49bb2bead tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:13.694188 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5df3affe-96be-4131-bbfb-50d49bb2bead tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:13.695163 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5df3affe-96be-4131-bbfb-50d49bb2bead tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:13.696317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5df3affe-96be-4131-bbfb-50d49bb2bead tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:13.771825 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5df3affe-96be-4131-bbfb-50d49bb2bead tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:13.782790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5df3affe-96be-4131-bbfb-50d49bb2bead tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1614 microversion: 2.1 time: 0.107786 Sep 13 01:24:13.798877 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 374/734] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:13 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1614 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:14.317368 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3055f567-8076-4630-b9c3-59ef793e0bfb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:14.318354 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3055f567-8076-4630-b9c3-59ef793e0bfb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:14.325119 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3055f567-8076-4630-b9c3-59ef793e0bfb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:14.326266 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3055f567-8076-4630-b9c3-59ef793e0bfb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:14.326928 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3055f567-8076-4630-b9c3-59ef793e0bfb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:14.327996 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3055f567-8076-4630-b9c3-59ef793e0bfb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:14.329351 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3055f567-8076-4630-b9c3-59ef793e0bfb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:14.330446 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3055f567-8076-4630-b9c3-59ef793e0bfb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:14.489789 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3055f567-8076-4630-b9c3-59ef793e0bfb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:14.501710 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3055f567-8076-4630-b9c3-59ef793e0bfb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:14.503354 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3055f567-8076-4630-b9c3-59ef793e0bfb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:14.504752 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3055f567-8076-4630-b9c3-59ef793e0bfb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1738 microversion: 2.20 time: 0.201600 Sep 13 01:24:14.505664 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 361/735] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:14 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1738 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:14.807502 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-80c12bce-405b-4bf9-9be1-746d86b2d756 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:14.808996 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-80c12bce-405b-4bf9-9be1-746d86b2d756 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:14.816071 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80c12bce-405b-4bf9-9be1-746d86b2d756 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:14.816682 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80c12bce-405b-4bf9-9be1-746d86b2d756 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:14.817324 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80c12bce-405b-4bf9-9be1-746d86b2d756 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:14.818192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80c12bce-405b-4bf9-9be1-746d86b2d756 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:14.818781 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80c12bce-405b-4bf9-9be1-746d86b2d756 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:14.819242 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-80c12bce-405b-4bf9-9be1-746d86b2d756 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:14.892871 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-80c12bce-405b-4bf9-9be1-746d86b2d756 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:14.901589 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-80c12bce-405b-4bf9-9be1-746d86b2d756 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1326 microversion: 2.1 time: 0.097558 Sep 13 01:24:14.902366 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 375/736] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:14 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:15.529640 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-20122eb9-7118-4247-b269-58107667aa8b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:15.530246 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-20122eb9-7118-4247-b269-58107667aa8b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:15.537259 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-20122eb9-7118-4247-b269-58107667aa8b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:15.538016 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-20122eb9-7118-4247-b269-58107667aa8b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:15.538668 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-20122eb9-7118-4247-b269-58107667aa8b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:15.539459 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-20122eb9-7118-4247-b269-58107667aa8b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:15.539912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-20122eb9-7118-4247-b269-58107667aa8b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:15.540336 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-20122eb9-7118-4247-b269-58107667aa8b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:15.688331 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-20122eb9-7118-4247-b269-58107667aa8b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:15.697380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-20122eb9-7118-4247-b269-58107667aa8b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:15.698965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-20122eb9-7118-4247-b269-58107667aa8b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:15.700194 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-20122eb9-7118-4247-b269-58107667aa8b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1738 microversion: 2.20 time: 0.174453 Sep 13 01:24:15.701271 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 362/737] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:15 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1738 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:15.924621 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:15.925364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:15.936625 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:15.937374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:15.939266 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:15.939984 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:15.940439 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:15.940868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:16.006007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:16.006497 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:16.006955 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:16.007402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lazy-loading 'fault' on Instance uuid 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:24:16.053417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:16.063353 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e104e896-373a-4397-9759-dc554efb2bfc tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 200 len: 1331 microversion: 2.1 time: 0.142597 Sep 13 01:24:16.064159 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 376/738] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:15 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 1331 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:16.727858 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b7a44825-82b4-4221-bed9-03fb27824411 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:16.728462 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b7a44825-82b4-4221-bed9-03fb27824411 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:16.734744 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b7a44825-82b4-4221-bed9-03fb27824411 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:16.735257 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b7a44825-82b4-4221-bed9-03fb27824411 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:16.735686 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b7a44825-82b4-4221-bed9-03fb27824411 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:16.736363 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b7a44825-82b4-4221-bed9-03fb27824411 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:16.736810 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b7a44825-82b4-4221-bed9-03fb27824411 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:16.737226 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b7a44825-82b4-4221-bed9-03fb27824411 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:16.872085 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b7a44825-82b4-4221-bed9-03fb27824411 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:16.880164 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b7a44825-82b4-4221-bed9-03fb27824411 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:16.881632 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b7a44825-82b4-4221-bed9-03fb27824411 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:16.882791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b7a44825-82b4-4221-bed9-03fb27824411 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1738 microversion: 2.20 time: 0.158787 Sep 13 01:24:16.883397 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 363/739] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:16 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1738 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:17.087336 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4b328fd0-203c-4d3f-9928-19006456d574 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:17.088355 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4b328fd0-203c-4d3f-9928-19006456d574 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:17.095245 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b328fd0-203c-4d3f-9928-19006456d574 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:17.096014 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b328fd0-203c-4d3f-9928-19006456d574 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:17.096526 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b328fd0-203c-4d3f-9928-19006456d574 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:17.097310 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b328fd0-203c-4d3f-9928-19006456d574 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:17.097842 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b328fd0-203c-4d3f-9928-19006456d574 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:17.098342 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4b328fd0-203c-4d3f-9928-19006456d574 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:17.113091 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-4b328fd0-203c-4d3f-9928-19006456d574 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4b328fd0-203c-4d3f-9928-19006456d574 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 HTTP/1.1 Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:24:17.114913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:24:17.116190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:24:17.116190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:24:17.116190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:24:17.116190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:24:17.116190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:24:17.116190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:24:17.116190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:24:17.116190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:24:17.116190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:24:17.116190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:24:17.116190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:24:17.116190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '4334e1fb-8fd8-47e4-a1dd-fb08c0b83480'} Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:24:17.116962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:24:17.118257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:17.120270 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4b328fd0-203c-4d3f-9928-19006456d574 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 404 to user: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:24:17.120270 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4b328fd0-203c-4d3f-9928-19006456d574 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 404 len: 111 microversion: 2.1 time: 0.033013 Sep 13 01:24:17.120270 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 377/740] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:17 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:24:17.126394 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d83100eb-3602-4bb3-9677-fe54f503a6f8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '.version_select at 0x7fb05e2b0ca0>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:17.145726 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d83100eb-3602-4bb3-9677-fe54f503a6f8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-920275714" status: 202 len: 0 microversion: 2.1 time: 0.023092 Sep 13 01:24:17.146570 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 364/741] 10.222.0.15 () {58 vars in 1218 bytes} [Tue Sep 13 01:24:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-920275714 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:24:17.908128 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1d47bf63-1bbe-4fd8-bfe8-666d88f0091e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:17.908979 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1d47bf63-1bbe-4fd8-bfe8-666d88f0091e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:17.915422 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d47bf63-1bbe-4fd8-bfe8-666d88f0091e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:17.915963 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d47bf63-1bbe-4fd8-bfe8-666d88f0091e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:17.917107 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d47bf63-1bbe-4fd8-bfe8-666d88f0091e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:17.918105 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d47bf63-1bbe-4fd8-bfe8-666d88f0091e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:17.918563 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d47bf63-1bbe-4fd8-bfe8-666d88f0091e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:17.919016 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1d47bf63-1bbe-4fd8-bfe8-666d88f0091e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:17.996748 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-fa0fca63-5d1a-4042-9c13-4e17693c5b45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Action: 'create', calling method: .version_select at 0x7fb05e31b0d0>, body: {"keypair": {"name": "tempest-keypair-1570457703", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKlJkyqWlLxaG08BZhKOks+Tk78ozpVI8n++26s7Tkgnqn+ssak+WY0agff4mtePRzGYbDUmB3a4nWpnlZ3lAIElwJBtG+rtUgm2uejCJI6afRhVz4vpxRchp9SJQID5qQ=="}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:18.016852 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-fa0fca63-5d1a-4042-9c13-4e17693c5b45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for project 30ce8239a9b34af685743812ce53ef19. Resources: {'key_pairs'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:24:18.021779 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-fa0fca63-5d1a-4042-9c13-4e17693c5b45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for user 776733af5b6a4115b2a11d67666a379d and project 30ce8239a9b34af685743812ce53ef19. Resources: {'key_pairs'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:24:18.051109 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-fa0fca63-5d1a-4042-9c13-4e17693c5b45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.058986 Sep 13 01:24:18.051724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 365/742] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 01:24:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:24:18.051724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-37264e9a-e779-4dfd-b21a-0173ba3a68e2 req-459b7119-f5ae-410f-a7e0-8f8c33ed24ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d56cdc-0d80-4681-9384-b1df6e5a403d", "name": "network-vif-unplugged", "status": "completed", "tag": "7eba6092-8d78-465f-a5ad-642414710fd4"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:18.064102 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1d47bf63-1bbe-4fd8-bfe8-666d88f0091e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:18.066033 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-37264e9a-e779-4dfd-b21a-0173ba3a68e2 req-459b7119-f5ae-410f-a7e0-8f8c33ed24ba service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:18.066742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-37264e9a-e779-4dfd-b21a-0173ba3a68e2 req-459b7119-f5ae-410f-a7e0-8f8c33ed24ba service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:18.067297 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-37264e9a-e779-4dfd-b21a-0173ba3a68e2 req-459b7119-f5ae-410f-a7e0-8f8c33ed24ba service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:18.073666 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1d47bf63-1bbe-4fd8-bfe8-666d88f0091e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:18.075463 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1d47bf63-1bbe-4fd8-bfe8-666d88f0091e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:18.076814 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1d47bf63-1bbe-4fd8-bfe8-666d88f0091e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1720 microversion: 2.20 time: 0.172809 Sep 13 01:24:18.081568 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-37264e9a-e779-4dfd-b21a-0173ba3a68e2 req-459b7119-f5ae-410f-a7e0-8f8c33ed24ba service nova] Creating event network-vif-unplugged:7eba6092-8d78-465f-a5ad-642414710fd4 for instance 29d56cdc-0d80-4681-9384-b1df6e5a403d on hv-cinder-85694 Sep 13 01:24:18.090559 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 378/743] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:17 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1720 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:18.091128 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-37264e9a-e779-4dfd-b21a-0173ba3a68e2 req-459b7119-f5ae-410f-a7e0-8f8c33ed24ba service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037858 Sep 13 01:24:18.091616 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 366/744] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:24:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:19.105329 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ddd42fef-f5a6-41c0-9535-2be50586c15c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:19.105962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ddd42fef-f5a6-41c0-9535-2be50586c15c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:19.112519 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ddd42fef-f5a6-41c0-9535-2be50586c15c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:19.112995 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ddd42fef-f5a6-41c0-9535-2be50586c15c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:19.113421 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ddd42fef-f5a6-41c0-9535-2be50586c15c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:19.114106 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ddd42fef-f5a6-41c0-9535-2be50586c15c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:19.114555 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ddd42fef-f5a6-41c0-9535-2be50586c15c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:19.114999 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ddd42fef-f5a6-41c0-9535-2be50586c15c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:19.318894 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ddd42fef-f5a6-41c0-9535-2be50586c15c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:19.327283 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ddd42fef-f5a6-41c0-9535-2be50586c15c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:19.328707 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ddd42fef-f5a6-41c0-9535-2be50586c15c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:19.329848 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ddd42fef-f5a6-41c0-9535-2be50586c15c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1720 microversion: 2.20 time: 0.229035 Sep 13 01:24:19.330397 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 379/745] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:19 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1720 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:19.392586 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1009034629", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ed8fe8c3-8c67-4c53-9bb3-c1aeeaaaf18e"}], "security_groups": [{"name": "tempest-securitygroup--1791035645"}], "key_name": "tempest-keypair-1570457703", "user_data": "}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:19.493244 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.network.neutron [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] validate_networks() for [('ed8fe8c3-8c67-4c53-9bb3-c1aeeaaaf18e', None, None, None, None, None)] {{(pid=120412) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:24:19.937830 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Flavor limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:24:19.938250 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Image limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:24:19.938719 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Flavor pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:24:19.939149 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Image pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:24:19.939558 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:24:19.948696 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:19.949169 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:19.949598 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:19.950307 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:19.950752 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:19.951195 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:19.967827 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for project 30ce8239a9b34af685743812ce53ef19. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:24:19.971673 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Getting quotas for user 776733af5b6a4115b2a11d67666a379d and project 30ce8239a9b34af685743812ce53ef19. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:24:19.982390 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Going to run 1 instances... {{(pid=120412) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:24:19.984784 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120412) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:24:20.033552 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-65c5e0fe-b180-4781-8630-9603331652d2 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.645945 Sep 13 01:24:20.034128 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 367/746] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:24:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 01:24:20.045114 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-803c435a-637b-4fc8-8793-df7e0962320a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:20.045731 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-803c435a-637b-4fc8-8793-df7e0962320a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:20.099526 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-803c435a-637b-4fc8-8793-df7e0962320a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:20.107216 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-803c435a-637b-4fc8-8793-df7e0962320a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1242 microversion: 2.1 time: 0.065784 Sep 13 01:24:20.107841 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 380/747] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:20 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:20.354710 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1366b993-0220-43d0-b292-8e0be422ab7f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:20.355457 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1366b993-0220-43d0-b292-8e0be422ab7f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:20.362634 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1366b993-0220-43d0-b292-8e0be422ab7f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:20.363285 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1366b993-0220-43d0-b292-8e0be422ab7f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:20.363720 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1366b993-0220-43d0-b292-8e0be422ab7f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:20.364416 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1366b993-0220-43d0-b292-8e0be422ab7f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:20.365074 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1366b993-0220-43d0-b292-8e0be422ab7f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:20.365487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1366b993-0220-43d0-b292-8e0be422ab7f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:20.504057 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1366b993-0220-43d0-b292-8e0be422ab7f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:20.512607 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1366b993-0220-43d0-b292-8e0be422ab7f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:20.514225 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1366b993-0220-43d0-b292-8e0be422ab7f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:20.515431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1366b993-0220-43d0-b292-8e0be422ab7f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1723 microversion: 2.20 time: 0.164656 Sep 13 01:24:20.515983 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 368/748] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:20 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:24:20.540901 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a79dfd66-c562-4c69-852d-599b0bd83443 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a617d56d-b1e4-437a-b391-5d6450061251"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:20.543310 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a79dfd66-c562-4c69-852d-599b0bd83443 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:20.551851 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a79dfd66-c562-4c69-852d-599b0bd83443 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:20.552334 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a79dfd66-c562-4c69-852d-599b0bd83443 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:20.552770 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a79dfd66-c562-4c69-852d-599b0bd83443 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:20.553453 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a79dfd66-c562-4c69-852d-599b0bd83443 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:20.553903 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a79dfd66-c562-4c69-852d-599b0bd83443 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:20.554322 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a79dfd66-c562-4c69-852d-599b0bd83443 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:20.843454 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a79dfd66-c562-4c69-852d-599b0bd83443 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "POST /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306752 Sep 13 01:24:20.844041 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 381/749] 10.222.0.15 () {62 vars in 1364 bytes} [Tue Sep 13 01:24:20 2022] POST /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 13 01:24:20.975169 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8d6776ee-2890-4fcd-a0ea-4d9ce70bc0d1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:20.975670 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-8d6776ee-2890-4fcd-a0ea-4d9ce70bc0d1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:20.982521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d6776ee-2890-4fcd-a0ea-4d9ce70bc0d1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:20.983037 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d6776ee-2890-4fcd-a0ea-4d9ce70bc0d1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:20.983477 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d6776ee-2890-4fcd-a0ea-4d9ce70bc0d1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:20.984165 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d6776ee-2890-4fcd-a0ea-4d9ce70bc0d1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:20.984622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d6776ee-2890-4fcd-a0ea-4d9ce70bc0d1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:20.985050 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8d6776ee-2890-4fcd-a0ea-4d9ce70bc0d1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:21.065435 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:21.128648 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-52f18d4e-3cff-4b61-ada8-07922179536b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:21.129274 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-52f18d4e-3cff-4b61-ada8-07922179536b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:21.135691 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52f18d4e-3cff-4b61-ada8-07922179536b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:21.136163 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52f18d4e-3cff-4b61-ada8-07922179536b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:21.136589 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52f18d4e-3cff-4b61-ada8-07922179536b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:21.137282 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52f18d4e-3cff-4b61-ada8-07922179536b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:21.137732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52f18d4e-3cff-4b61-ada8-07922179536b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:21.138128 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-52f18d4e-3cff-4b61-ada8-07922179536b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:21.201592 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-52f18d4e-3cff-4b61-ada8-07922179536b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:21.209228 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-52f18d4e-3cff-4b61-ada8-07922179536b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1246 microversion: 2.1 time: 0.084368 Sep 13 01:24:21.209791 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 382/750] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:21 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1246 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:21.698320 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-8d6776ee-2890-4fcd-a0ea-4d9ce70bc0d1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "DELETE /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/os-volume_attachments/a617d56d-b1e4-437a-b391-5d6450061251" status: 202 len: 0 microversion: 2.20 time: 0.728015 Sep 13 01:24:21.698974 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 369/751] 10.222.0.15 () {60 vars in 1457 bytes} [Tue Sep 13 01:24:20 2022] DELETE /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/os-volume_attachments/a617d56d-b1e4-437a-b391-5d6450061251 => generated 0 bytes in 730 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:24:21.768316 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-963e0625-5081-4e87-a41c-6552ad489f5d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:21.768912 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-963e0625-5081-4e87-a41c-6552ad489f5d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:21.775249 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-963e0625-5081-4e87-a41c-6552ad489f5d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:21.775729 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-963e0625-5081-4e87-a41c-6552ad489f5d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:21.776162 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-963e0625-5081-4e87-a41c-6552ad489f5d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:21.776847 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-963e0625-5081-4e87-a41c-6552ad489f5d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:21.777301 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-963e0625-5081-4e87-a41c-6552ad489f5d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:21.777718 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-963e0625-5081-4e87-a41c-6552ad489f5d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:21.791017 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:21.871153 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-963e0625-5081-4e87-a41c-6552ad489f5d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120415) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 13 01:24:21.938846 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-963e0625-5081-4e87-a41c-6552ad489f5d tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "POST /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/action" status: 202 len: 0 microversion: 2.20 time: 0.174255 Sep 13 01:24:21.939586 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 383/752] 10.222.0.15 () {62 vars in 1319 bytes} [Tue Sep 13 01:24:21 2022] POST /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:24:21.948594 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b72c2af2-371a-4c33-9ca4-33231b0e5874 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:21.949259 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b72c2af2-371a-4c33-9ca4-33231b0e5874 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:21.956627 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b72c2af2-371a-4c33-9ca4-33231b0e5874 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:21.957113 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b72c2af2-371a-4c33-9ca4-33231b0e5874 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:21.957543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b72c2af2-371a-4c33-9ca4-33231b0e5874 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:21.958516 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b72c2af2-371a-4c33-9ca4-33231b0e5874 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:21.959102 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b72c2af2-371a-4c33-9ca4-33231b0e5874 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:21.959493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b72c2af2-371a-4c33-9ca4-33231b0e5874 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:22.125085 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b72c2af2-371a-4c33-9ca4-33231b0e5874 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:22.133540 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b72c2af2-371a-4c33-9ca4-33231b0e5874 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:22.135002 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b72c2af2-371a-4c33-9ca4-33231b0e5874 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:22.136211 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b72c2af2-371a-4c33-9ca4-33231b0e5874 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1731 microversion: 2.20 time: 0.192192 Sep 13 01:24:22.136789 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 370/753] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:21 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1731 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:22.232418 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3000ffbc-d385-46f2-a4f8-a0e75f9b713c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:22.233835 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3000ffbc-d385-46f2-a4f8-a0e75f9b713c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:22.239814 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3000ffbc-d385-46f2-a4f8-a0e75f9b713c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:22.240314 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3000ffbc-d385-46f2-a4f8-a0e75f9b713c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:22.240651 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3000ffbc-d385-46f2-a4f8-a0e75f9b713c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:22.241345 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3000ffbc-d385-46f2-a4f8-a0e75f9b713c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:22.241797 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3000ffbc-d385-46f2-a4f8-a0e75f9b713c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:22.242234 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3000ffbc-d385-46f2-a4f8-a0e75f9b713c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:22.313220 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3000ffbc-d385-46f2-a4f8-a0e75f9b713c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:22.320841 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3000ffbc-d385-46f2-a4f8-a0e75f9b713c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1246 microversion: 2.1 time: 0.092236 Sep 13 01:24:22.321411 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 384/754] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:22 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:23.164163 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-30d522af-100a-41e8-b4ed-2c999db67cc4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:23.165285 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-30d522af-100a-41e8-b4ed-2c999db67cc4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:23.175361 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-30d522af-100a-41e8-b4ed-2c999db67cc4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:23.177844 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-30d522af-100a-41e8-b4ed-2c999db67cc4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:23.178531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-30d522af-100a-41e8-b4ed-2c999db67cc4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:23.179836 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-30d522af-100a-41e8-b4ed-2c999db67cc4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:23.180312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-30d522af-100a-41e8-b4ed-2c999db67cc4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:23.180723 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-30d522af-100a-41e8-b4ed-2c999db67cc4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:23.336040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-30d522af-100a-41e8-b4ed-2c999db67cc4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:23.348934 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d5f8ace1-713b-4294-8cbe-36bd66707346 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:23.351284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d5f8ace1-713b-4294-8cbe-36bd66707346 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:23.351568 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-30d522af-100a-41e8-b4ed-2c999db67cc4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:23.354157 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-30d522af-100a-41e8-b4ed-2c999db67cc4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:23.355428 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-30d522af-100a-41e8-b4ed-2c999db67cc4 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1673 microversion: 2.20 time: 0.197487 Sep 13 01:24:23.355741 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:23.363172 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d5f8ace1-713b-4294-8cbe-36bd66707346 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:23.364104 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d5f8ace1-713b-4294-8cbe-36bd66707346 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:23.364945 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d5f8ace1-713b-4294-8cbe-36bd66707346 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:23.365886 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d5f8ace1-713b-4294-8cbe-36bd66707346 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:23.366549 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d5f8ace1-713b-4294-8cbe-36bd66707346 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:23.367369 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d5f8ace1-713b-4294-8cbe-36bd66707346 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:23.372263 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 371/755] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:23 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1673 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:23.476932 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d5f8ace1-713b-4294-8cbe-36bd66707346 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:23.486665 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d5f8ace1-713b-4294-8cbe-36bd66707346 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1302 microversion: 2.1 time: 0.145565 Sep 13 01:24:23.487346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 385/756] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:23 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1302 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:24.382603 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7fec7fd8-64e6-431b-9511-99daaaacaedb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:24.383262 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7fec7fd8-64e6-431b-9511-99daaaacaedb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:24.393086 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7fec7fd8-64e6-431b-9511-99daaaacaedb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:24.393504 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7fec7fd8-64e6-431b-9511-99daaaacaedb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:24.393943 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7fec7fd8-64e6-431b-9511-99daaaacaedb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:24.396979 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7fec7fd8-64e6-431b-9511-99daaaacaedb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:24.397457 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7fec7fd8-64e6-431b-9511-99daaaacaedb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:24.397901 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7fec7fd8-64e6-431b-9511-99daaaacaedb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:24.509436 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b480f880-f2f1-43ca-9f7e-f6b0bc53169a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:24.510084 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b480f880-f2f1-43ca-9f7e-f6b0bc53169a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:24.516498 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b480f880-f2f1-43ca-9f7e-f6b0bc53169a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:24.517065 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b480f880-f2f1-43ca-9f7e-f6b0bc53169a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:24.518268 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b480f880-f2f1-43ca-9f7e-f6b0bc53169a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:24.519150 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b480f880-f2f1-43ca-9f7e-f6b0bc53169a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:24.519697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b480f880-f2f1-43ca-9f7e-f6b0bc53169a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:24.520203 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b480f880-f2f1-43ca-9f7e-f6b0bc53169a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:24.659533 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b480f880-f2f1-43ca-9f7e-f6b0bc53169a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:24.669710 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b480f880-f2f1-43ca-9f7e-f6b0bc53169a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.163918 Sep 13 01:24:24.670316 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 386/757] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:24 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:24.788786 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7fec7fd8-64e6-431b-9511-99daaaacaedb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:24.797712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7fec7fd8-64e6-431b-9511-99daaaacaedb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:24.799487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7fec7fd8-64e6-431b-9511-99daaaacaedb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:24.800782 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7fec7fd8-64e6-431b-9511-99daaaacaedb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.422957 Sep 13 01:24:24.801353 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 372/758] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:24 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:25.462267 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-b9f98fd7-b199-4082-a383-081d8fe8fcef req-b99396ed-3408-4e28-8f1b-b3696ff21472 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc43951-6c00-456d-bc95-10f6a0771001", "tag": "4e09343f-3c4a-4429-8bc0-ccdaffa8df31"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:25.473987 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-b9f98fd7-b199-4082-a383-081d8fe8fcef req-b99396ed-3408-4e28-8f1b-b3696ff21472 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:25.474472 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-b9f98fd7-b199-4082-a383-081d8fe8fcef req-b99396ed-3408-4e28-8f1b-b3696ff21472 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:25.474932 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-b9f98fd7-b199-4082-a383-081d8fe8fcef req-b99396ed-3408-4e28-8f1b-b3696ff21472 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:25.488469 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-b9f98fd7-b199-4082-a383-081d8fe8fcef req-b99396ed-3408-4e28-8f1b-b3696ff21472 service nova] Creating event network-changed:4e09343f-3c4a-4429-8bc0-ccdaffa8df31 for instance ecc43951-6c00-456d-bc95-10f6a0771001 on hv-cinder-85694 Sep 13 01:24:25.493912 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-b9f98fd7-b199-4082-a383-081d8fe8fcef req-b99396ed-3408-4e28-8f1b-b3696ff21472 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.200433 Sep 13 01:24:25.495194 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 387/759] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:25.693708 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ddb67641-157a-43c8-a589-181f53a8939a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:25.694458 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ddb67641-157a-43c8-a589-181f53a8939a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:25.701962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ddb67641-157a-43c8-a589-181f53a8939a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:25.703372 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ddb67641-157a-43c8-a589-181f53a8939a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:25.704183 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ddb67641-157a-43c8-a589-181f53a8939a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:25.705092 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ddb67641-157a-43c8-a589-181f53a8939a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:25.705737 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ddb67641-157a-43c8-a589-181f53a8939a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:25.706567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ddb67641-157a-43c8-a589-181f53a8939a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:25.833365 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4479f75f-4da8-4bfd-80b9-8d6adda18ab5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:25.834389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4479f75f-4da8-4bfd-80b9-8d6adda18ab5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:25.843615 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4479f75f-4da8-4bfd-80b9-8d6adda18ab5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:25.844930 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4479f75f-4da8-4bfd-80b9-8d6adda18ab5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:25.845618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4479f75f-4da8-4bfd-80b9-8d6adda18ab5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:25.847502 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4479f75f-4da8-4bfd-80b9-8d6adda18ab5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:25.848262 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4479f75f-4da8-4bfd-80b9-8d6adda18ab5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:25.850839 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4479f75f-4da8-4bfd-80b9-8d6adda18ab5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:25.922266 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ddb67641-157a-43c8-a589-181f53a8939a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:25.936709 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ddb67641-157a-43c8-a589-181f53a8939a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.246567 Sep 13 01:24:25.938283 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 373/760] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:25 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:26.020468 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4479f75f-4da8-4bfd-80b9-8d6adda18ab5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:26.031268 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4479f75f-4da8-4bfd-80b9-8d6adda18ab5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:26.033184 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4479f75f-4da8-4bfd-80b9-8d6adda18ab5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:26.034429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4479f75f-4da8-4bfd-80b9-8d6adda18ab5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.208427 Sep 13 01:24:26.035010 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 388/761] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:25 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:24:26.962281 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3e18c29a-f4c0-4b28-8957-e95eb16b302a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:26.963014 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3e18c29a-f4c0-4b28-8957-e95eb16b302a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:26.970023 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e18c29a-f4c0-4b28-8957-e95eb16b302a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:26.970483 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e18c29a-f4c0-4b28-8957-e95eb16b302a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:26.971141 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e18c29a-f4c0-4b28-8957-e95eb16b302a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:26.971814 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e18c29a-f4c0-4b28-8957-e95eb16b302a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:26.972269 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e18c29a-f4c0-4b28-8957-e95eb16b302a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:26.972879 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e18c29a-f4c0-4b28-8957-e95eb16b302a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:27.060332 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6f3d321f-ec39-4cee-be83-64bf1ede7b9a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:27.060933 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6f3d321f-ec39-4cee-be83-64bf1ede7b9a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:27.068626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f3d321f-ec39-4cee-be83-64bf1ede7b9a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:27.075825 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f3d321f-ec39-4cee-be83-64bf1ede7b9a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:27.076275 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f3d321f-ec39-4cee-be83-64bf1ede7b9a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:27.077008 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f3d321f-ec39-4cee-be83-64bf1ede7b9a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:27.077455 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f3d321f-ec39-4cee-be83-64bf1ede7b9a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:27.077867 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f3d321f-ec39-4cee-be83-64bf1ede7b9a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:27.153234 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3e18c29a-f4c0-4b28-8957-e95eb16b302a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:27.171661 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3e18c29a-f4c0-4b28-8957-e95eb16b302a tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.213896 Sep 13 01:24:27.187769 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 374/762] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:26 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:27.298956 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6f3d321f-ec39-4cee-be83-64bf1ede7b9a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:27.307841 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6f3d321f-ec39-4cee-be83-64bf1ede7b9a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:27.309424 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6f3d321f-ec39-4cee-be83-64bf1ede7b9a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:27.310840 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6f3d321f-ec39-4cee-be83-64bf1ede7b9a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.254830 Sep 13 01:24:27.321393 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 389/763] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:27 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:28.194774 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-323a2496-171f-4f62-b162-5486a782c2c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:28.195591 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-323a2496-171f-4f62-b162-5486a782c2c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:28.202431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-323a2496-171f-4f62-b162-5486a782c2c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:28.203178 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-323a2496-171f-4f62-b162-5486a782c2c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:28.203828 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-323a2496-171f-4f62-b162-5486a782c2c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:28.204733 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-323a2496-171f-4f62-b162-5486a782c2c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:28.205282 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-323a2496-171f-4f62-b162-5486a782c2c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:28.205898 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-323a2496-171f-4f62-b162-5486a782c2c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:28.337866 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a46e6e7b-ce2b-4193-b66d-092625cf9bd0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:28.338588 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a46e6e7b-ce2b-4193-b66d-092625cf9bd0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:28.347207 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a46e6e7b-ce2b-4193-b66d-092625cf9bd0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:28.348049 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a46e6e7b-ce2b-4193-b66d-092625cf9bd0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:28.348707 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a46e6e7b-ce2b-4193-b66d-092625cf9bd0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:28.349642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a46e6e7b-ce2b-4193-b66d-092625cf9bd0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:28.350158 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a46e6e7b-ce2b-4193-b66d-092625cf9bd0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:28.351463 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a46e6e7b-ce2b-4193-b66d-092625cf9bd0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:28.356949 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-323a2496-171f-4f62-b162-5486a782c2c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:28.366384 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-323a2496-171f-4f62-b162-5486a782c2c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.175188 Sep 13 01:24:28.367617 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 375/764] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:28 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:28.529339 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a46e6e7b-ce2b-4193-b66d-092625cf9bd0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:28.537540 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a46e6e7b-ce2b-4193-b66d-092625cf9bd0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:28.539258 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a46e6e7b-ce2b-4193-b66d-092625cf9bd0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:28.540621 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a46e6e7b-ce2b-4193-b66d-092625cf9bd0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.206804 Sep 13 01:24:28.541749 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 390/765] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:28 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:24:29.391045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b2c67b82-66eb-4aef-bb23-ef0c7da9bf31 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:29.392246 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b2c67b82-66eb-4aef-bb23-ef0c7da9bf31 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:29.399006 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:29.401328 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b2c67b82-66eb-4aef-bb23-ef0c7da9bf31 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:29.402430 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b2c67b82-66eb-4aef-bb23-ef0c7da9bf31 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:29.403121 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b2c67b82-66eb-4aef-bb23-ef0c7da9bf31 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:29.404059 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b2c67b82-66eb-4aef-bb23-ef0c7da9bf31 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:29.404749 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b2c67b82-66eb-4aef-bb23-ef0c7da9bf31 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:29.405402 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b2c67b82-66eb-4aef-bb23-ef0c7da9bf31 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:29.564742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b2c67b82-66eb-4aef-bb23-ef0c7da9bf31 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:29.568136 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ce8267d4-cce3-4924-8ffc-a219edf25c34 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:29.569568 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ce8267d4-cce3-4924-8ffc-a219edf25c34 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:29.577680 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ce8267d4-cce3-4924-8ffc-a219edf25c34 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:29.578205 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b2c67b82-66eb-4aef-bb23-ef0c7da9bf31 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.191314 Sep 13 01:24:29.578747 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ce8267d4-cce3-4924-8ffc-a219edf25c34 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:29.579511 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ce8267d4-cce3-4924-8ffc-a219edf25c34 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:29.580536 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ce8267d4-cce3-4924-8ffc-a219edf25c34 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:29.581196 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ce8267d4-cce3-4924-8ffc-a219edf25c34 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:29.581821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ce8267d4-cce3-4924-8ffc-a219edf25c34 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:29.584609 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 376/766] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:29 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:29.737680 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ce8267d4-cce3-4924-8ffc-a219edf25c34 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:29.757269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ce8267d4-cce3-4924-8ffc-a219edf25c34 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:29.759289 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ce8267d4-cce3-4924-8ffc-a219edf25c34 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:29.761177 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ce8267d4-cce3-4924-8ffc-a219edf25c34 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.197573 Sep 13 01:24:29.761792 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 391/767] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:29 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:24:29.960907 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:29.979241 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=10 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:30.168290 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-43ac3ff0-83e8-464a-b159-01824d6a36a9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:30.168795 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-43ac3ff0-83e8-464a-b159-01824d6a36a9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:30.178086 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-43ac3ff0-83e8-464a-b159-01824d6a36a9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:30.178582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-43ac3ff0-83e8-464a-b159-01824d6a36a9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:30.179073 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-43ac3ff0-83e8-464a-b159-01824d6a36a9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:30.179800 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-43ac3ff0-83e8-464a-b159-01824d6a36a9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:30.180255 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-43ac3ff0-83e8-464a-b159-01824d6a36a9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:30.180687 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-43ac3ff0-83e8-464a-b159-01824d6a36a9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:30.205475 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-43ac3ff0-83e8-464a-b159-01824d6a36a9 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/ips" status: 200 len: 145 microversion: 2.1 time: 0.262571 Sep 13 01:24:30.206051 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 377/768] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 01:24:29 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/ips => generated 145 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:30.601606 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-12935b2f-352f-4164-8837-0825ae3b5582 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:30.602199 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-12935b2f-352f-4164-8837-0825ae3b5582 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:30.605441 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:30.610597 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-12935b2f-352f-4164-8837-0825ae3b5582 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:30.611106 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-12935b2f-352f-4164-8837-0825ae3b5582 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:30.611549 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-12935b2f-352f-4164-8837-0825ae3b5582 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:30.612237 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-12935b2f-352f-4164-8837-0825ae3b5582 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:30.612683 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-12935b2f-352f-4164-8837-0825ae3b5582 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:30.613099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-12935b2f-352f-4164-8837-0825ae3b5582 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:30.746963 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-12935b2f-352f-4164-8837-0825ae3b5582 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:30.754784 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-12935b2f-352f-4164-8837-0825ae3b5582 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.156996 Sep 13 01:24:30.755585 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 392/769] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:30 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:30.786322 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-46e3fb6e-ee7c-4954-96bd-10aa8483a79e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:30.787044 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-46e3fb6e-ee7c-4954-96bd-10aa8483a79e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:30.793393 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46e3fb6e-ee7c-4954-96bd-10aa8483a79e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:30.793884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46e3fb6e-ee7c-4954-96bd-10aa8483a79e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:30.794324 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46e3fb6e-ee7c-4954-96bd-10aa8483a79e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:30.795098 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46e3fb6e-ee7c-4954-96bd-10aa8483a79e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:30.795585 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46e3fb6e-ee7c-4954-96bd-10aa8483a79e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:30.796029 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46e3fb6e-ee7c-4954-96bd-10aa8483a79e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:30.943903 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-46e3fb6e-ee7c-4954-96bd-10aa8483a79e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:30.953951 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-46e3fb6e-ee7c-4954-96bd-10aa8483a79e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:30.955437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-46e3fb6e-ee7c-4954-96bd-10aa8483a79e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:30.956651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-46e3fb6e-ee7c-4954-96bd-10aa8483a79e tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.174260 Sep 13 01:24:30.957253 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 378/770] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:30 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:31.063453 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1655081814", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "networks": [{"uuid": "59526115-cee6-4eef-ab50-f84cd1e85872"}]}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:31.122088 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] validate_networks() for [('59526115-cee6-4eef-ab50-f84cd1e85872', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:24:31.491945 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:24:31.492362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:24:31.492832 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:24:31.493233 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:24:31.493655 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:24:31.503365 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:31.503892 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:31.504322 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:31.505044 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:31.505497 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:31.505915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:31.523365 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Getting quotas for project 99cfba5cf9d54e10ba5fc677bf713e2f. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:24:31.528370 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Getting quotas for user 38ba0a3f69474e4ba60361b5c48f4579 and project 99cfba5cf9d54e10ba5fc677bf713e2f. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:24:31.541185 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:24:31.543500 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:24:31.596710 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f80bbab3-4719-48dc-99da-e3fe53420c8e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.533194 Sep 13 01:24:31.596710 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 393/771] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:24:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 535 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 01:24:31.614453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9964b574-2a3f-404b-b2bb-10a3ad675b0c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:31.619705 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9964b574-2a3f-404b-b2bb-10a3ad675b0c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:31.623546 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b69ba938-5aeb-47cd-9b83-f3a482319300 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8f85bb8-922f-4169-8154-d1ec8a0883f9"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:31.626121 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b69ba938-5aeb-47cd-9b83-f3a482319300 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:31.639471 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b69ba938-5aeb-47cd-9b83-f3a482319300 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:31.639956 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b69ba938-5aeb-47cd-9b83-f3a482319300 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:31.640566 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b69ba938-5aeb-47cd-9b83-f3a482319300 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:31.641457 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b69ba938-5aeb-47cd-9b83-f3a482319300 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:31.642062 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b69ba938-5aeb-47cd-9b83-f3a482319300 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:31.643366 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b69ba938-5aeb-47cd-9b83-f3a482319300 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:31.704172 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-9964b574-2a3f-404b-b2bb-10a3ad675b0c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:31.711294 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9964b574-2a3f-404b-b2bb-10a3ad675b0c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1214 microversion: 2.1 time: 0.109291 Sep 13 01:24:31.711855 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 379/772] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:31 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:31.778455 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3fa4f9c7-9a70-4911-b79e-3c2029205693 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:31.779007 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3fa4f9c7-9a70-4911-b79e-3c2029205693 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:31.786727 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3fa4f9c7-9a70-4911-b79e-3c2029205693 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:31.787415 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3fa4f9c7-9a70-4911-b79e-3c2029205693 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:31.787967 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3fa4f9c7-9a70-4911-b79e-3c2029205693 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:31.789494 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3fa4f9c7-9a70-4911-b79e-3c2029205693 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:31.789968 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3fa4f9c7-9a70-4911-b79e-3c2029205693 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:31.790501 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3fa4f9c7-9a70-4911-b79e-3c2029205693 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:31.976198 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-3fa4f9c7-9a70-4911-b79e-3c2029205693 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:31.984619 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3fa4f9c7-9a70-4911-b79e-3c2029205693 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.210827 Sep 13 01:24:31.996664 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 380/773] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:31 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:32.000492 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-cde9d357-4216-4199-a2dc-0c7ed58b1e8a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:32.001486 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-cde9d357-4216-4199-a2dc-0c7ed58b1e8a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:32.007935 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cde9d357-4216-4199-a2dc-0c7ed58b1e8a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:32.008422 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cde9d357-4216-4199-a2dc-0c7ed58b1e8a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:32.008851 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cde9d357-4216-4199-a2dc-0c7ed58b1e8a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:32.010070 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cde9d357-4216-4199-a2dc-0c7ed58b1e8a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:32.010543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cde9d357-4216-4199-a2dc-0c7ed58b1e8a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:32.010967 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cde9d357-4216-4199-a2dc-0c7ed58b1e8a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:32.175495 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-cde9d357-4216-4199-a2dc-0c7ed58b1e8a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:32.200855 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-cde9d357-4216-4199-a2dc-0c7ed58b1e8a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:32.205078 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-cde9d357-4216-4199-a2dc-0c7ed58b1e8a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:32.206387 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-cde9d357-4216-4199-a2dc-0c7ed58b1e8a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.219862 Sep 13 01:24:32.212312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 381/774] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:31 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:32.736908 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-bfa907f2-5d9a-463c-b766-52f4e0d13968 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:32.737776 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-bfa907f2-5d9a-463c-b766-52f4e0d13968 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:32.744092 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfa907f2-5d9a-463c-b766-52f4e0d13968 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:32.744689 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfa907f2-5d9a-463c-b766-52f4e0d13968 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:32.745196 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfa907f2-5d9a-463c-b766-52f4e0d13968 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:32.745969 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfa907f2-5d9a-463c-b766-52f4e0d13968 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:32.746503 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfa907f2-5d9a-463c-b766-52f4e0d13968 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:32.747031 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bfa907f2-5d9a-463c-b766-52f4e0d13968 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:32.808860 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-bfa907f2-5d9a-463c-b766-52f4e0d13968 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:32.816594 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-bfa907f2-5d9a-463c-b766-52f4e0d13968 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1218 microversion: 2.1 time: 0.083528 Sep 13 01:24:32.817201 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 382/775] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:32 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:33.006693 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-488f4468-6a4c-4367-afd0-47aa2d0c1c8d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:33.007334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-488f4468-6a4c-4367-afd0-47aa2d0c1c8d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:33.014308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-488f4468-6a4c-4367-afd0-47aa2d0c1c8d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:33.014790 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-488f4468-6a4c-4367-afd0-47aa2d0c1c8d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:33.015280 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-488f4468-6a4c-4367-afd0-47aa2d0c1c8d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:33.016159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-488f4468-6a4c-4367-afd0-47aa2d0c1c8d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:33.016648 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-488f4468-6a4c-4367-afd0-47aa2d0c1c8d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:33.017085 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-488f4468-6a4c-4367-afd0-47aa2d0c1c8d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:33.164973 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-488f4468-6a4c-4367-afd0-47aa2d0c1c8d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:33.200252 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-488f4468-6a4c-4367-afd0-47aa2d0c1c8d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.197296 Sep 13 01:24:33.200845 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 383/776] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:33 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:33.233342 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-6b91ba61-d932-428f-aeb1-3e34df8faffb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:33.233981 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-6b91ba61-d932-428f-aeb1-3e34df8faffb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:33.240377 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6b91ba61-d932-428f-aeb1-3e34df8faffb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:33.240977 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6b91ba61-d932-428f-aeb1-3e34df8faffb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:33.241406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6b91ba61-d932-428f-aeb1-3e34df8faffb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:33.242435 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6b91ba61-d932-428f-aeb1-3e34df8faffb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:33.242910 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6b91ba61-d932-428f-aeb1-3e34df8faffb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:33.243331 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-6b91ba61-d932-428f-aeb1-3e34df8faffb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:33.380610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6b91ba61-d932-428f-aeb1-3e34df8faffb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:33.388756 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6b91ba61-d932-428f-aeb1-3e34df8faffb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:33.390195 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-6b91ba61-d932-428f-aeb1-3e34df8faffb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:33.391386 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-6b91ba61-d932-428f-aeb1-3e34df8faffb tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.162030 Sep 13 01:24:33.392259 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 384/777] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:33 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:24:33.840042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-08beec93-3bfd-459d-8282-025809966b82 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:33.840759 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-08beec93-3bfd-459d-8282-025809966b82 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:33.846530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-08beec93-3bfd-459d-8282-025809966b82 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:33.847039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-08beec93-3bfd-459d-8282-025809966b82 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:33.847470 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-08beec93-3bfd-459d-8282-025809966b82 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:33.848150 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-08beec93-3bfd-459d-8282-025809966b82 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:33.848599 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-08beec93-3bfd-459d-8282-025809966b82 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:33.849020 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-08beec93-3bfd-459d-8282-025809966b82 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:33.867646 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:33.914594 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-08beec93-3bfd-459d-8282-025809966b82 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:33.923622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-08beec93-3bfd-459d-8282-025809966b82 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1218 microversion: 2.1 time: 0.087797 Sep 13 01:24:33.924764 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 385/778] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:33 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1218 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:34.223998 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4a5345c8-4bce-4fbe-a189-27bcfc306faf tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:34.224616 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4a5345c8-4bce-4fbe-a189-27bcfc306faf tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:34.231046 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4a5345c8-4bce-4fbe-a189-27bcfc306faf tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:34.231532 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4a5345c8-4bce-4fbe-a189-27bcfc306faf tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:34.231966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4a5345c8-4bce-4fbe-a189-27bcfc306faf tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:34.232655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4a5345c8-4bce-4fbe-a189-27bcfc306faf tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:34.233105 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4a5345c8-4bce-4fbe-a189-27bcfc306faf tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:34.233522 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4a5345c8-4bce-4fbe-a189-27bcfc306faf tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:34.375487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-4a5345c8-4bce-4fbe-a189-27bcfc306faf tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:34.383426 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4a5345c8-4bce-4fbe-a189-27bcfc306faf tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.163206 Sep 13 01:24:34.384012 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 386/779] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:34 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:34.416702 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-2cc149bb-c495-4352-a407-f5a0ac084d61 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:34.417392 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-2cc149bb-c495-4352-a407-f5a0ac084d61 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:34.423877 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2cc149bb-c495-4352-a407-f5a0ac084d61 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:34.424363 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2cc149bb-c495-4352-a407-f5a0ac084d61 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:34.424796 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2cc149bb-c495-4352-a407-f5a0ac084d61 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:34.425495 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2cc149bb-c495-4352-a407-f5a0ac084d61 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:34.425942 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2cc149bb-c495-4352-a407-f5a0ac084d61 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:34.426360 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2cc149bb-c495-4352-a407-f5a0ac084d61 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:34.559371 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2cc149bb-c495-4352-a407-f5a0ac084d61 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:34.567871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2cc149bb-c495-4352-a407-f5a0ac084d61 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:34.569315 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2cc149bb-c495-4352-a407-f5a0ac084d61 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:34.570494 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-2cc149bb-c495-4352-a407-f5a0ac084d61 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.157917 Sep 13 01:24:34.571096 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 387/780] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:34 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:24:34.951975 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-31805b31-8cd2-4f6d-bd83-364630b6e336 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:34.952663 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-31805b31-8cd2-4f6d-bd83-364630b6e336 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:34.958637 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-31805b31-8cd2-4f6d-bd83-364630b6e336 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:34.959167 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-31805b31-8cd2-4f6d-bd83-364630b6e336 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:34.959606 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-31805b31-8cd2-4f6d-bd83-364630b6e336 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:34.960302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-31805b31-8cd2-4f6d-bd83-364630b6e336 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:34.960758 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-31805b31-8cd2-4f6d-bd83-364630b6e336 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:34.961183 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-31805b31-8cd2-4f6d-bd83-364630b6e336 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:35.025819 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-31805b31-8cd2-4f6d-bd83-364630b6e336 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:35.033536 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-31805b31-8cd2-4f6d-bd83-364630b6e336 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1218 microversion: 2.1 time: 0.085493 Sep 13 01:24:35.034118 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 388/781] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:34 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:35.230544 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b69ba938-5aeb-47cd-9b83-f3a482319300 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "POST /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.622621 Sep 13 01:24:35.231175 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 394/782] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:24:31 2022] POST /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments => generated 194 bytes in 3624 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:35.406597 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d16a7545-8cde-4ea5-bdc9-0af0d1c4b59d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:35.407164 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d16a7545-8cde-4ea5-bdc9-0af0d1c4b59d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:35.413856 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d16a7545-8cde-4ea5-bdc9-0af0d1c4b59d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:35.413981 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d16a7545-8cde-4ea5-bdc9-0af0d1c4b59d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:35.414362 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d16a7545-8cde-4ea5-bdc9-0af0d1c4b59d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:35.415080 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d16a7545-8cde-4ea5-bdc9-0af0d1c4b59d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:35.416203 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d16a7545-8cde-4ea5-bdc9-0af0d1c4b59d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:35.416621 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d16a7545-8cde-4ea5-bdc9-0af0d1c4b59d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:35.543874 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d16a7545-8cde-4ea5-bdc9-0af0d1c4b59d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:35.551404 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d16a7545-8cde-4ea5-bdc9-0af0d1c4b59d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.148780 Sep 13 01:24:35.551970 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 389/783] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:35 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:35.597263 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-eee52a65-4769-4fb8-b660-463648fb743f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:35.597957 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-eee52a65-4769-4fb8-b660-463648fb743f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:35.604037 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eee52a65-4769-4fb8-b660-463648fb743f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:35.604521 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eee52a65-4769-4fb8-b660-463648fb743f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:35.604955 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eee52a65-4769-4fb8-b660-463648fb743f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:35.605637 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eee52a65-4769-4fb8-b660-463648fb743f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:35.606091 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eee52a65-4769-4fb8-b660-463648fb743f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:35.606509 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-eee52a65-4769-4fb8-b660-463648fb743f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:35.734693 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-eee52a65-4769-4fb8-b660-463648fb743f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:35.742723 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-eee52a65-4769-4fb8-b660-463648fb743f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:35.744285 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-eee52a65-4769-4fb8-b660-463648fb743f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:35.745451 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-eee52a65-4769-4fb8-b660-463648fb743f tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.152848 Sep 13 01:24:35.746003 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 395/784] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:35 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:36.057039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e0e64ff4-a259-4ea8-8e63-e0c5661c38ad tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:36.057649 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-e0e64ff4-a259-4ea8-8e63-e0c5661c38ad tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:36.063513 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0e64ff4-a259-4ea8-8e63-e0c5661c38ad tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:36.063992 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0e64ff4-a259-4ea8-8e63-e0c5661c38ad tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:36.064423 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0e64ff4-a259-4ea8-8e63-e0c5661c38ad tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:36.065101 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0e64ff4-a259-4ea8-8e63-e0c5661c38ad tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:36.065545 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0e64ff4-a259-4ea8-8e63-e0c5661c38ad tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:36.065960 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e0e64ff4-a259-4ea8-8e63-e0c5661c38ad tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:36.125109 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-e0e64ff4-a259-4ea8-8e63-e0c5661c38ad tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:36.132696 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-e0e64ff4-a259-4ea8-8e63-e0c5661c38ad tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1210 microversion: 2.1 time: 0.080242 Sep 13 01:24:36.133259 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 390/785] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:36 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1210 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:36.574029 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d9d9fdeb-f5ab-4161-bcd1-7de5f18960c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:36.575402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d9d9fdeb-f5ab-4161-bcd1-7de5f18960c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:36.583210 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9d9fdeb-f5ab-4161-bcd1-7de5f18960c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:36.583849 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9d9fdeb-f5ab-4161-bcd1-7de5f18960c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:36.584291 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9d9fdeb-f5ab-4161-bcd1-7de5f18960c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:36.584994 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9d9fdeb-f5ab-4161-bcd1-7de5f18960c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:36.585459 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9d9fdeb-f5ab-4161-bcd1-7de5f18960c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:36.585885 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d9d9fdeb-f5ab-4161-bcd1-7de5f18960c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:36.728721 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d9d9fdeb-f5ab-4161-bcd1-7de5f18960c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:36.736363 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d9d9fdeb-f5ab-4161-bcd1-7de5f18960c5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.166544 Sep 13 01:24:36.736926 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 396/786] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:36 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:36.771650 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-78803213-4c9d-4cfc-9a07-86e9ecc40bc1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:36.772203 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-78803213-4c9d-4cfc-9a07-86e9ecc40bc1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:36.779387 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-78803213-4c9d-4cfc-9a07-86e9ecc40bc1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:36.779879 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-78803213-4c9d-4cfc-9a07-86e9ecc40bc1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:36.780312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-78803213-4c9d-4cfc-9a07-86e9ecc40bc1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:36.781011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-78803213-4c9d-4cfc-9a07-86e9ecc40bc1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:36.781469 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-78803213-4c9d-4cfc-9a07-86e9ecc40bc1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:36.781969 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-78803213-4c9d-4cfc-9a07-86e9ecc40bc1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:36.911779 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-78803213-4c9d-4cfc-9a07-86e9ecc40bc1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:36.920309 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-78803213-4c9d-4cfc-9a07-86e9ecc40bc1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:36.921736 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-78803213-4c9d-4cfc-9a07-86e9ecc40bc1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:36.922910 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-78803213-4c9d-4cfc-9a07-86e9ecc40bc1 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.155870 Sep 13 01:24:36.923473 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 391/787] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:36 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:37.156910 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1a388d78-94c7-4b9f-bd3a-b30d54d9b935 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:37.157449 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1a388d78-94c7-4b9f-bd3a-b30d54d9b935 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:37.163758 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a388d78-94c7-4b9f-bd3a-b30d54d9b935 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:37.164238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a388d78-94c7-4b9f-bd3a-b30d54d9b935 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:37.164670 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a388d78-94c7-4b9f-bd3a-b30d54d9b935 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:37.165376 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a388d78-94c7-4b9f-bd3a-b30d54d9b935 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:37.165823 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a388d78-94c7-4b9f-bd3a-b30d54d9b935 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:37.166240 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a388d78-94c7-4b9f-bd3a-b30d54d9b935 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:37.227441 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1a388d78-94c7-4b9f-bd3a-b30d54d9b935 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:37.234825 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1a388d78-94c7-4b9f-bd3a-b30d54d9b935 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1266 microversion: 2.1 time: 0.082318 Sep 13 01:24:37.235407 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 397/788] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:37 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:37.759817 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-37784c40-5547-4ec0-b999-57df4d373e09 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:37.760583 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-37784c40-5547-4ec0-b999-57df4d373e09 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:37.766612 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-37784c40-5547-4ec0-b999-57df4d373e09 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:37.767333 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-37784c40-5547-4ec0-b999-57df4d373e09 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:37.767962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-37784c40-5547-4ec0-b999-57df4d373e09 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:37.768927 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-37784c40-5547-4ec0-b999-57df4d373e09 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:37.769548 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-37784c40-5547-4ec0-b999-57df4d373e09 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:37.770110 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-37784c40-5547-4ec0-b999-57df4d373e09 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:37.948662 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-92d8d531-92e9-40b0-ae61-1e4a0b5b57da tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:37.949278 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-92d8d531-92e9-40b0-ae61-1e4a0b5b57da tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:37.956250 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-92d8d531-92e9-40b0-ae61-1e4a0b5b57da tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:37.956768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-92d8d531-92e9-40b0-ae61-1e4a0b5b57da tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:37.957301 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-92d8d531-92e9-40b0-ae61-1e4a0b5b57da tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:37.958110 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-92d8d531-92e9-40b0-ae61-1e4a0b5b57da tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:37.959090 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-92d8d531-92e9-40b0-ae61-1e4a0b5b57da tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:37.959778 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-92d8d531-92e9-40b0-ae61-1e4a0b5b57da tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:38.109290 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-37784c40-5547-4ec0-b999-57df4d373e09 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:38.122800 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-37784c40-5547-4ec0-b999-57df4d373e09 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.367783 Sep 13 01:24:38.139691 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 392/789] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:37 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:38.281531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-46eb26a6-c871-4a8e-bb50-b9fa51254463 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:38.284039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-46eb26a6-c871-4a8e-bb50-b9fa51254463 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:38.298266 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46eb26a6-c871-4a8e-bb50-b9fa51254463 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:38.299072 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46eb26a6-c871-4a8e-bb50-b9fa51254463 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:38.299701 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46eb26a6-c871-4a8e-bb50-b9fa51254463 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:38.300615 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46eb26a6-c871-4a8e-bb50-b9fa51254463 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:38.301363 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46eb26a6-c871-4a8e-bb50-b9fa51254463 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:38.301951 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46eb26a6-c871-4a8e-bb50-b9fa51254463 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:38.389115 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-46eb26a6-c871-4a8e-bb50-b9fa51254463 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:38.398108 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-46eb26a6-c871-4a8e-bb50-b9fa51254463 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1272 microversion: 2.1 time: 0.142042 Sep 13 01:24:38.415054 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 393/790] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:38 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1272 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:38.415272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-92d8d531-92e9-40b0-ae61-1e4a0b5b57da tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:38.427260 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-92d8d531-92e9-40b0-ae61-1e4a0b5b57da tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:38.429143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-92d8d531-92e9-40b0-ae61-1e4a0b5b57da tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:38.430938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-92d8d531-92e9-40b0-ae61-1e4a0b5b57da tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.486017 Sep 13 01:24:38.442880 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 398/791] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:37 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:24:39.221119 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-74b230a1-1bfa-4954-ab12-dc32a556df45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:39.222828 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-74b230a1-1bfa-4954-ab12-dc32a556df45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:39.231865 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-74b230a1-1bfa-4954-ab12-dc32a556df45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:39.233583 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-74b230a1-1bfa-4954-ab12-dc32a556df45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:39.234015 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-74b230a1-1bfa-4954-ab12-dc32a556df45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:39.235059 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-74b230a1-1bfa-4954-ab12-dc32a556df45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:39.235726 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-74b230a1-1bfa-4954-ab12-dc32a556df45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:39.236332 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-74b230a1-1bfa-4954-ab12-dc32a556df45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:39.426185 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f965b72e-3b03-4232-a12c-7c3468ecc3a7 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:39.426916 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f965b72e-3b03-4232-a12c-7c3468ecc3a7 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:39.433585 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f965b72e-3b03-4232-a12c-7c3468ecc3a7 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:39.434153 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f965b72e-3b03-4232-a12c-7c3468ecc3a7 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:39.434679 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f965b72e-3b03-4232-a12c-7c3468ecc3a7 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:39.435500 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f965b72e-3b03-4232-a12c-7c3468ecc3a7 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:39.436067 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f965b72e-3b03-4232-a12c-7c3468ecc3a7 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:39.436497 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f965b72e-3b03-4232-a12c-7c3468ecc3a7 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:39.440594 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:39.449911 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-74b230a1-1bfa-4954-ab12-dc32a556df45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:39.459811 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-74b230a1-1bfa-4954-ab12-dc32a556df45 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.298931 Sep 13 01:24:39.460402 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 394/792] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:39 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:39.466015 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0d8b25c6-0dfe-468d-a943-3cf99376371b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:39.466622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0d8b25c6-0dfe-468d-a943-3cf99376371b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:39.473118 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0d8b25c6-0dfe-468d-a943-3cf99376371b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:39.473611 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0d8b25c6-0dfe-468d-a943-3cf99376371b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:39.474050 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0d8b25c6-0dfe-468d-a943-3cf99376371b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:39.474753 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0d8b25c6-0dfe-468d-a943-3cf99376371b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:39.475232 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0d8b25c6-0dfe-468d-a943-3cf99376371b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:39.475661 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0d8b25c6-0dfe-468d-a943-3cf99376371b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:39.583162 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f965b72e-3b03-4232-a12c-7c3468ecc3a7 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:39.591455 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f965b72e-3b03-4232-a12c-7c3468ecc3a7 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1314 microversion: 2.1 time: 0.169268 Sep 13 01:24:39.592024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 399/793] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:39 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:39.611801 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-f7edff00-a593-400b-b136-28a34dbe56c3 req-97b0beb3-5fa3-419f-8810-98d6c5153a4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5886aa7b-f2e4-49b9-9a6b-fb4546d47372", "tag": "f4269d77-acf2-4422-92da-6b2acc94de4e"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:39.621287 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f7edff00-a593-400b-b136-28a34dbe56c3 req-97b0beb3-5fa3-419f-8810-98d6c5153a4b service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:39.621767 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f7edff00-a593-400b-b136-28a34dbe56c3 req-97b0beb3-5fa3-419f-8810-98d6c5153a4b service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:39.622253 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f7edff00-a593-400b-b136-28a34dbe56c3 req-97b0beb3-5fa3-419f-8810-98d6c5153a4b service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:39.640007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-f7edff00-a593-400b-b136-28a34dbe56c3 req-97b0beb3-5fa3-419f-8810-98d6c5153a4b service nova] Creating event network-changed:f4269d77-acf2-4422-92da-6b2acc94de4e for instance 5886aa7b-f2e4-49b9-9a6b-fb4546d47372 on hv-cinder-85694 Sep 13 01:24:39.644781 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-f7edff00-a593-400b-b136-28a34dbe56c3 req-97b0beb3-5fa3-419f-8810-98d6c5153a4b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036695 Sep 13 01:24:39.645413 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 400/794] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:24:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:24:39.737617 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0d8b25c6-0dfe-468d-a943-3cf99376371b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:39.746396 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0d8b25c6-0dfe-468d-a943-3cf99376371b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:39.747957 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0d8b25c6-0dfe-468d-a943-3cf99376371b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:39.749159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0d8b25c6-0dfe-468d-a943-3cf99376371b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.287835 Sep 13 01:24:39.749709 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 395/795] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:39 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:40.321064 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-864056f7-e3af-4079-873a-8c2867eb1f3e req-2916b57d-8040-4e7b-b2d4-1dde8432c0a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc43951-6c00-456d-bc95-10f6a0771001", "name": "network-vif-plugged", "status": "completed", "tag": "4e09343f-3c4a-4429-8bc0-ccdaffa8df31"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:40.332617 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-864056f7-e3af-4079-873a-8c2867eb1f3e req-2916b57d-8040-4e7b-b2d4-1dde8432c0a1 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:40.333345 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-864056f7-e3af-4079-873a-8c2867eb1f3e req-2916b57d-8040-4e7b-b2d4-1dde8432c0a1 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:40.333707 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-864056f7-e3af-4079-873a-8c2867eb1f3e req-2916b57d-8040-4e7b-b2d4-1dde8432c0a1 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:40.345431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-864056f7-e3af-4079-873a-8c2867eb1f3e req-2916b57d-8040-4e7b-b2d4-1dde8432c0a1 service nova] Creating event network-vif-plugged:4e09343f-3c4a-4429-8bc0-ccdaffa8df31 for instance ecc43951-6c00-456d-bc95-10f6a0771001 on hv-cinder-85694 Sep 13 01:24:40.350344 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-864056f7-e3af-4079-873a-8c2867eb1f3e req-2916b57d-8040-4e7b-b2d4-1dde8432c0a1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.105151 Sep 13 01:24:40.350957 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 401/796] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:24:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:40.483766 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-015c80c9-4a51-4ef9-a175-3225ba542870 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:40.484487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-015c80c9-4a51-4ef9-a175-3225ba542870 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:40.491056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-015c80c9-4a51-4ef9-a175-3225ba542870 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:40.491540 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-015c80c9-4a51-4ef9-a175-3225ba542870 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:40.491965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-015c80c9-4a51-4ef9-a175-3225ba542870 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:40.492652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-015c80c9-4a51-4ef9-a175-3225ba542870 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:40.493100 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-015c80c9-4a51-4ef9-a175-3225ba542870 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:40.493691 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-015c80c9-4a51-4ef9-a175-3225ba542870 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:40.614142 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e35e5f7f-eb4e-4fb0-94e1-dde26d083390 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:40.615139 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e35e5f7f-eb4e-4fb0-94e1-dde26d083390 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:40.621412 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-015c80c9-4a51-4ef9-a175-3225ba542870 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:40.621912 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e35e5f7f-eb4e-4fb0-94e1-dde26d083390 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:40.622623 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e35e5f7f-eb4e-4fb0-94e1-dde26d083390 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:40.623161 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e35e5f7f-eb4e-4fb0-94e1-dde26d083390 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:40.623982 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e35e5f7f-eb4e-4fb0-94e1-dde26d083390 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:40.624504 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e35e5f7f-eb4e-4fb0-94e1-dde26d083390 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:40.624931 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e35e5f7f-eb4e-4fb0-94e1-dde26d083390 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:40.629094 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-015c80c9-4a51-4ef9-a175-3225ba542870 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.149216 Sep 13 01:24:40.629666 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 396/797] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:40 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:40.753432 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e35e5f7f-eb4e-4fb0-94e1-dde26d083390 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:40.760892 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e35e5f7f-eb4e-4fb0-94e1-dde26d083390 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1314 microversion: 2.1 time: 0.151024 Sep 13 01:24:40.761455 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 402/798] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:40 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:40.776638 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c3ecaf61-4a46-4ede-8770-4afe8d2ab8b9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:40.777337 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c3ecaf61-4a46-4ede-8770-4afe8d2ab8b9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:40.783245 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c3ecaf61-4a46-4ede-8770-4afe8d2ab8b9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:40.783733 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c3ecaf61-4a46-4ede-8770-4afe8d2ab8b9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:40.784169 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c3ecaf61-4a46-4ede-8770-4afe8d2ab8b9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:40.784861 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c3ecaf61-4a46-4ede-8770-4afe8d2ab8b9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:40.785317 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c3ecaf61-4a46-4ede-8770-4afe8d2ab8b9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:40.785743 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c3ecaf61-4a46-4ede-8770-4afe8d2ab8b9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:40.914865 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c3ecaf61-4a46-4ede-8770-4afe8d2ab8b9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:40.922803 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c3ecaf61-4a46-4ede-8770-4afe8d2ab8b9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:40.924294 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c3ecaf61-4a46-4ede-8770-4afe8d2ab8b9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:40.925455 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c3ecaf61-4a46-4ede-8770-4afe8d2ab8b9 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.153448 Sep 13 01:24:40.926024 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 397/799] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:40 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:24:41.651613 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fef8eb93-d8cc-43dd-bf38-abe44ddfa558 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:41.652137 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fef8eb93-d8cc-43dd-bf38-abe44ddfa558 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:41.654261 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:41.654942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=6 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:41.662028 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fef8eb93-d8cc-43dd-bf38-abe44ddfa558 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:41.662883 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fef8eb93-d8cc-43dd-bf38-abe44ddfa558 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:41.663328 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fef8eb93-d8cc-43dd-bf38-abe44ddfa558 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:41.664030 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fef8eb93-d8cc-43dd-bf38-abe44ddfa558 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:41.664476 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fef8eb93-d8cc-43dd-bf38-abe44ddfa558 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:41.664891 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fef8eb93-d8cc-43dd-bf38-abe44ddfa558 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:41.783598 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a5f0eea6-ba6c-4c87-8fec-2e5e95d86870 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:41.784889 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a5f0eea6-ba6c-4c87-8fec-2e5e95d86870 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:41.788352 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:41.792846 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5f0eea6-ba6c-4c87-8fec-2e5e95d86870 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:41.793332 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5f0eea6-ba6c-4c87-8fec-2e5e95d86870 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:41.793764 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5f0eea6-ba6c-4c87-8fec-2e5e95d86870 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:41.794460 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5f0eea6-ba6c-4c87-8fec-2e5e95d86870 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:41.794938 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5f0eea6-ba6c-4c87-8fec-2e5e95d86870 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:41.795365 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5f0eea6-ba6c-4c87-8fec-2e5e95d86870 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:41.798392 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fef8eb93-d8cc-43dd-bf38-abe44ddfa558 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:41.807973 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fef8eb93-d8cc-43dd-bf38-abe44ddfa558 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1368 microversion: 2.1 time: 0.160172 Sep 13 01:24:41.808542 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 403/800] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:41 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1368 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:41.926106 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a5f0eea6-ba6c-4c87-8fec-2e5e95d86870 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:41.934422 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a5f0eea6-ba6c-4c87-8fec-2e5e95d86870 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1314 microversion: 2.1 time: 0.154673 Sep 13 01:24:41.935002 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 398/801] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:41 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:41.949481 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5263239b-9fc7-4acd-a3f4-74550fabb4e0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:41.950084 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5263239b-9fc7-4acd-a3f4-74550fabb4e0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:41.955968 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5263239b-9fc7-4acd-a3f4-74550fabb4e0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:41.956450 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5263239b-9fc7-4acd-a3f4-74550fabb4e0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:41.956882 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5263239b-9fc7-4acd-a3f4-74550fabb4e0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:41.957567 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5263239b-9fc7-4acd-a3f4-74550fabb4e0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:41.958018 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5263239b-9fc7-4acd-a3f4-74550fabb4e0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:41.958442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5263239b-9fc7-4acd-a3f4-74550fabb4e0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:42.093296 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5263239b-9fc7-4acd-a3f4-74550fabb4e0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:42.101296 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5263239b-9fc7-4acd-a3f4-74550fabb4e0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:42.103317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5263239b-9fc7-4acd-a3f4-74550fabb4e0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:42.104471 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5263239b-9fc7-4acd-a3f4-74550fabb4e0 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.158917 Sep 13 01:24:42.105025 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 404/802] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:41 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:42.378511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-32667919-2590-4acd-9fa7-2f02d75e7ccc req-8a8a7bc5-f6b4-434e-b4d6-dd3b72350830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d56cdc-0d80-4681-9384-b1df6e5a403d", "name": "network-vif-plugged", "status": "completed", "tag": "7eba6092-8d78-465f-a5ad-642414710fd4"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:42.388693 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-32667919-2590-4acd-9fa7-2f02d75e7ccc req-8a8a7bc5-f6b4-434e-b4d6-dd3b72350830 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:42.389169 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-32667919-2590-4acd-9fa7-2f02d75e7ccc req-8a8a7bc5-f6b4-434e-b4d6-dd3b72350830 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:42.389606 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-32667919-2590-4acd-9fa7-2f02d75e7ccc req-8a8a7bc5-f6b4-434e-b4d6-dd3b72350830 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:42.401757 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-32667919-2590-4acd-9fa7-2f02d75e7ccc req-8a8a7bc5-f6b4-434e-b4d6-dd3b72350830 service nova] Creating event network-vif-plugged:7eba6092-8d78-465f-a5ad-642414710fd4 for instance 29d56cdc-0d80-4681-9384-b1df6e5a403d on hv-cinder-85694 Sep 13 01:24:42.408239 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-32667919-2590-4acd-9fa7-2f02d75e7ccc req-8a8a7bc5-f6b4-434e-b4d6-dd3b72350830 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034311 Sep 13 01:24:42.408995 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 399/803] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:24:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:42.831074 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-93edf31b-6a23-490f-9f8f-8363f6247db8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:42.831706 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-93edf31b-6a23-490f-9f8f-8363f6247db8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:42.838058 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-93edf31b-6a23-490f-9f8f-8363f6247db8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:42.838546 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-93edf31b-6a23-490f-9f8f-8363f6247db8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:42.839008 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-93edf31b-6a23-490f-9f8f-8363f6247db8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:42.839731 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-93edf31b-6a23-490f-9f8f-8363f6247db8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:42.840188 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-93edf31b-6a23-490f-9f8f-8363f6247db8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:42.840614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-93edf31b-6a23-490f-9f8f-8363f6247db8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:42.957256 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-bec2e30a-3a6f-435e-9a46-18ced8416dbb tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:42.957897 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-bec2e30a-3a6f-435e-9a46-18ced8416dbb tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:42.964430 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bec2e30a-3a6f-435e-9a46-18ced8416dbb tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:42.964899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bec2e30a-3a6f-435e-9a46-18ced8416dbb tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:42.965334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bec2e30a-3a6f-435e-9a46-18ced8416dbb tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:42.966030 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bec2e30a-3a6f-435e-9a46-18ced8416dbb tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:42.966931 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bec2e30a-3a6f-435e-9a46-18ced8416dbb tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:42.967361 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-bec2e30a-3a6f-435e-9a46-18ced8416dbb tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:42.969189 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-93edf31b-6a23-490f-9f8f-8363f6247db8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:42.976901 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-93edf31b-6a23-490f-9f8f-8363f6247db8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1558 microversion: 2.1 time: 0.149683 Sep 13 01:24:42.977525 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 405/804] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:42 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:42.999547 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0556716c-af3a-4a69-a852-328b29bf78a6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:43.000040 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0556716c-af3a-4a69-a852-328b29bf78a6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:43.005929 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0556716c-af3a-4a69-a852-328b29bf78a6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:43.006413 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0556716c-af3a-4a69-a852-328b29bf78a6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:43.006843 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0556716c-af3a-4a69-a852-328b29bf78a6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:43.007597 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0556716c-af3a-4a69-a852-328b29bf78a6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:43.008047 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0556716c-af3a-4a69-a852-328b29bf78a6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:43.008473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0556716c-af3a-4a69-a852-328b29bf78a6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:43.088236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0556716c-af3a-4a69-a852-328b29bf78a6 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092432 Sep 13 01:24:43.088835 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 406/805] 10.222.0.15 () {58 vars in 1275 bytes} [Tue Sep 13 01:24:42 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:24:43.103905 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-bec2e30a-3a6f-435e-9a46-18ced8416dbb tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:43.111874 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-bec2e30a-3a6f-435e-9a46-18ced8416dbb tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1314 microversion: 2.1 time: 0.158956 Sep 13 01:24:43.112452 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 400/806] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:42 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:43.129421 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5a88d07c-057f-4652-b46c-bfbd5b2c02b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:43.130125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5a88d07c-057f-4652-b46c-bfbd5b2c02b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:43.136138 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a88d07c-057f-4652-b46c-bfbd5b2c02b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:43.136616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a88d07c-057f-4652-b46c-bfbd5b2c02b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:43.137046 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a88d07c-057f-4652-b46c-bfbd5b2c02b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:43.137734 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a88d07c-057f-4652-b46c-bfbd5b2c02b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:43.138185 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a88d07c-057f-4652-b46c-bfbd5b2c02b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:43.138604 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5a88d07c-057f-4652-b46c-bfbd5b2c02b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:43.393749 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5a88d07c-057f-4652-b46c-bfbd5b2c02b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:43.401799 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5a88d07c-057f-4652-b46c-bfbd5b2c02b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:43.403335 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5a88d07c-057f-4652-b46c-bfbd5b2c02b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:43.404497 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5a88d07c-057f-4652-b46c-bfbd5b2c02b6 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.279073 Sep 13 01:24:43.418594 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 407/807] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:43 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:43.858361 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a3afcf3d-5946-4417-b3e9-e58d40bb987d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:43.860574 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a3afcf3d-5946-4417-b3e9-e58d40bb987d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:43.866722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a3afcf3d-5946-4417-b3e9-e58d40bb987d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:43.867299 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a3afcf3d-5946-4417-b3e9-e58d40bb987d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:43.867826 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a3afcf3d-5946-4417-b3e9-e58d40bb987d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:43.869189 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a3afcf3d-5946-4417-b3e9-e58d40bb987d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:43.869729 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a3afcf3d-5946-4417-b3e9-e58d40bb987d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:43.870225 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a3afcf3d-5946-4417-b3e9-e58d40bb987d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:43.900476 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a3afcf3d-5946-4417-b3e9-e58d40bb987d tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046133 Sep 13 01:24:43.901040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 401/808] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:24:43 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:43.911606 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fe1742f3-3da0-4568-9e38-76f207f7b84c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:43.912117 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fe1742f3-3da0-4568-9e38-76f207f7b84c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:43.919005 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe1742f3-3da0-4568-9e38-76f207f7b84c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:43.919498 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe1742f3-3da0-4568-9e38-76f207f7b84c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:43.919933 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe1742f3-3da0-4568-9e38-76f207f7b84c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:43.920659 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe1742f3-3da0-4568-9e38-76f207f7b84c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:43.921114 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe1742f3-3da0-4568-9e38-76f207f7b84c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:43.921570 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe1742f3-3da0-4568-9e38-76f207f7b84c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:43.951386 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fe1742f3-3da0-4568-9e38-76f207f7b84c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments/c8f85bb8-922f-4169-8154-d1ec8a0883f9" status: 200 len: 194 microversion: 2.1 time: 0.043537 Sep 13 01:24:43.952291 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 408/809] 10.222.0.15 () {58 vars in 1413 bytes} [Tue Sep 13 01:24:43 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments/c8f85bb8-922f-4169-8154-d1ec8a0883f9 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:44.135381 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5d0eb72e-31da-414c-8afe-54159da0ba72 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:44.136142 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5d0eb72e-31da-414c-8afe-54159da0ba72 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:44.142528 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d0eb72e-31da-414c-8afe-54159da0ba72 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:44.143252 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d0eb72e-31da-414c-8afe-54159da0ba72 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:44.143761 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d0eb72e-31da-414c-8afe-54159da0ba72 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:44.144724 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d0eb72e-31da-414c-8afe-54159da0ba72 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:44.145366 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d0eb72e-31da-414c-8afe-54159da0ba72 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:44.145865 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5d0eb72e-31da-414c-8afe-54159da0ba72 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:44.223881 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-d20ef18f-b32c-4486-be70-db8690fff829 req-d6d5a13f-e1a2-44d5-bc30-8888091dbd43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecc43951-6c00-456d-bc95-10f6a0771001", "tag": "4e09343f-3c4a-4429-8bc0-ccdaffa8df31"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:44.239762 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-d20ef18f-b32c-4486-be70-db8690fff829 req-d6d5a13f-e1a2-44d5-bc30-8888091dbd43 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:44.240316 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-d20ef18f-b32c-4486-be70-db8690fff829 req-d6d5a13f-e1a2-44d5-bc30-8888091dbd43 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:44.240873 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-d20ef18f-b32c-4486-be70-db8690fff829 req-d6d5a13f-e1a2-44d5-bc30-8888091dbd43 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:44.254002 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-d20ef18f-b32c-4486-be70-db8690fff829 req-d6d5a13f-e1a2-44d5-bc30-8888091dbd43 service nova] Creating event network-changed:4e09343f-3c4a-4429-8bc0-ccdaffa8df31 for instance ecc43951-6c00-456d-bc95-10f6a0771001 on hv-cinder-85694 Sep 13 01:24:44.261390 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-d20ef18f-b32c-4486-be70-db8690fff829 req-d6d5a13f-e1a2-44d5-bc30-8888091dbd43 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.135987 Sep 13 01:24:44.262008 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 402/810] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:44.341183 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5d0eb72e-31da-414c-8afe-54159da0ba72 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:44.349080 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5d0eb72e-31da-414c-8afe-54159da0ba72 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1314 microversion: 2.1 time: 0.217982 Sep 13 01:24:44.349644 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 409/811] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:44 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:44.430243 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ac455226-07cb-42f4-a921-1fb6bf707254 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:44.431119 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ac455226-07cb-42f4-a921-1fb6bf707254 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:44.437590 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ac455226-07cb-42f4-a921-1fb6bf707254 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:44.438072 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ac455226-07cb-42f4-a921-1fb6bf707254 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:44.438506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ac455226-07cb-42f4-a921-1fb6bf707254 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:44.439236 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ac455226-07cb-42f4-a921-1fb6bf707254 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:44.439690 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ac455226-07cb-42f4-a921-1fb6bf707254 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:44.440111 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ac455226-07cb-42f4-a921-1fb6bf707254 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:44.457675 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=100 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:44.476072 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-1615a99e-1cef-413c-9fcc-f37425fd17f8 req-7301838a-65c4-4fbc-a78c-b73b29e5ff9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5886aa7b-f2e4-49b9-9a6b-fb4546d47372", "name": "network-vif-plugged", "status": "completed", "tag": "f4269d77-acf2-4422-92da-6b2acc94de4e"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:44.486548 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-1615a99e-1cef-413c-9fcc-f37425fd17f8 req-7301838a-65c4-4fbc-a78c-b73b29e5ff9a service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:44.487070 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-1615a99e-1cef-413c-9fcc-f37425fd17f8 req-7301838a-65c4-4fbc-a78c-b73b29e5ff9a service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:44.487498 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-1615a99e-1cef-413c-9fcc-f37425fd17f8 req-7301838a-65c4-4fbc-a78c-b73b29e5ff9a service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:44.499066 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-1615a99e-1cef-413c-9fcc-f37425fd17f8 req-7301838a-65c4-4fbc-a78c-b73b29e5ff9a service nova] Creating event network-vif-plugged:f4269d77-acf2-4422-92da-6b2acc94de4e for instance 5886aa7b-f2e4-49b9-9a6b-fb4546d47372 on hv-cinder-85694 Sep 13 01:24:44.503995 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-1615a99e-1cef-413c-9fcc-f37425fd17f8 req-7301838a-65c4-4fbc-a78c-b73b29e5ff9a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032464 Sep 13 01:24:44.504629 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 410/812] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:24:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:44.585973 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ac455226-07cb-42f4-a921-1fb6bf707254 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:44.596964 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ac455226-07cb-42f4-a921-1fb6bf707254 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:44.598622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ac455226-07cb-42f4-a921-1fb6bf707254 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:44.600626 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ac455226-07cb-42f4-a921-1fb6bf707254 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.174270 Sep 13 01:24:44.601375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 403/813] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:44 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:24:45.375861 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6a5074a2-c2dc-46a8-aeb5-c9a4e68f9805 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:45.377663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6a5074a2-c2dc-46a8-aeb5-c9a4e68f9805 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:45.384372 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6a5074a2-c2dc-46a8-aeb5-c9a4e68f9805 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:45.385191 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6a5074a2-c2dc-46a8-aeb5-c9a4e68f9805 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:45.385865 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6a5074a2-c2dc-46a8-aeb5-c9a4e68f9805 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:45.386879 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6a5074a2-c2dc-46a8-aeb5-c9a4e68f9805 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:45.387394 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6a5074a2-c2dc-46a8-aeb5-c9a4e68f9805 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:45.388013 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6a5074a2-c2dc-46a8-aeb5-c9a4e68f9805 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:45.420873 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-33c879c9-4fc7-4976-8ee0-6b70998515ae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e467279-88a8-4888-ad98-65ba2c1c0e33"}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:45.424916 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-33c879c9-4fc7-4976-8ee0-6b70998515ae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:45.432453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-33c879c9-4fc7-4976-8ee0-6b70998515ae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:45.432980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-33c879c9-4fc7-4976-8ee0-6b70998515ae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:45.433350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-33c879c9-4fc7-4976-8ee0-6b70998515ae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:45.434936 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-33c879c9-4fc7-4976-8ee0-6b70998515ae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:45.435549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-33c879c9-4fc7-4976-8ee0-6b70998515ae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:45.436342 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-33c879c9-4fc7-4976-8ee0-6b70998515ae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:45.593243 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6a5074a2-c2dc-46a8-aeb5-c9a4e68f9805 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:45.606673 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6a5074a2-c2dc-46a8-aeb5-c9a4e68f9805 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1314 microversion: 2.1 time: 0.238094 Sep 13 01:24:45.607611 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 411/814] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:45 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:45.631189 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-32cbed49-254a-427a-bd58-9c59e88c960b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:45.631805 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-32cbed49-254a-427a-bd58-9c59e88c960b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:45.639943 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-32cbed49-254a-427a-bd58-9c59e88c960b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:45.640514 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-32cbed49-254a-427a-bd58-9c59e88c960b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:45.641015 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-32cbed49-254a-427a-bd58-9c59e88c960b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:45.641831 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-32cbed49-254a-427a-bd58-9c59e88c960b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:45.642324 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-32cbed49-254a-427a-bd58-9c59e88c960b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:45.642780 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-32cbed49-254a-427a-bd58-9c59e88c960b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:45.779732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-32cbed49-254a-427a-bd58-9c59e88c960b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:45.787752 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-32cbed49-254a-427a-bd58-9c59e88c960b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:45.789189 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-32cbed49-254a-427a-bd58-9c59e88c960b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:45.791023 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-32cbed49-254a-427a-bd58-9c59e88c960b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1729 microversion: 2.20 time: 0.166717 Sep 13 01:24:45.791556 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 412/815] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:45 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:24:46.631359 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-def21e5b-6635-4796-a2f4-8f3e1672fa9d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:46.631957 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-def21e5b-6635-4796-a2f4-8f3e1672fa9d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:46.639098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-def21e5b-6635-4796-a2f4-8f3e1672fa9d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:46.639625 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-def21e5b-6635-4796-a2f4-8f3e1672fa9d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:46.640058 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-def21e5b-6635-4796-a2f4-8f3e1672fa9d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:46.640805 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-def21e5b-6635-4796-a2f4-8f3e1672fa9d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:46.641255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-def21e5b-6635-4796-a2f4-8f3e1672fa9d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:46.641677 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-def21e5b-6635-4796-a2f4-8f3e1672fa9d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:46.773416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-def21e5b-6635-4796-a2f4-8f3e1672fa9d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:46.784310 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-def21e5b-6635-4796-a2f4-8f3e1672fa9d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1498 microversion: 2.1 time: 0.156725 Sep 13 01:24:46.784850 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 413/816] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:46 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1498 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:46.816414 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-df575b25-d296-42e8-a80d-cd10dbc11e87 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:46.817349 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-df575b25-d296-42e8-a80d-cd10dbc11e87 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:46.827425 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df575b25-d296-42e8-a80d-cd10dbc11e87 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:46.827942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df575b25-d296-42e8-a80d-cd10dbc11e87 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:46.828562 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df575b25-d296-42e8-a80d-cd10dbc11e87 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:46.829471 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df575b25-d296-42e8-a80d-cd10dbc11e87 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:46.830128 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df575b25-d296-42e8-a80d-cd10dbc11e87 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:46.831049 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-df575b25-d296-42e8-a80d-cd10dbc11e87 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:46.885843 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-33c879c9-4fc7-4976-8ee0-6b70998515ae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "POST /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.469007 Sep 13 01:24:46.887577 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 404/817] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:24:45 2022] POST /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments => generated 194 bytes in 1472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:47.010550 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-df575b25-d296-42e8-a80d-cd10dbc11e87 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:47.020876 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-df575b25-d296-42e8-a80d-cd10dbc11e87 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:47.022313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-df575b25-d296-42e8-a80d-cd10dbc11e87 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:47.023617 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-df575b25-d296-42e8-a80d-cd10dbc11e87 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1716 microversion: 2.20 time: 0.211393 Sep 13 01:24:47.024189 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 414/818] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:24:46 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1716 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 13 01:24:47.252412 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c7bdea90-9fa1-41f3-9502-12af6040f429 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:47.253025 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c7bdea90-9fa1-41f3-9502-12af6040f429 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:47.259779 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c7bdea90-9fa1-41f3-9502-12af6040f429 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:47.260265 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c7bdea90-9fa1-41f3-9502-12af6040f429 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:47.260882 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c7bdea90-9fa1-41f3-9502-12af6040f429 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:47.261662 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c7bdea90-9fa1-41f3-9502-12af6040f429 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:47.262262 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c7bdea90-9fa1-41f3-9502-12af6040f429 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:47.262775 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c7bdea90-9fa1-41f3-9502-12af6040f429 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:47.288241 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c7bdea90-9fa1-41f3-9502-12af6040f429 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Going to try to terminate instance {{(pid=120412) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:24:47.362955 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c7bdea90-9fa1-41f3-9502-12af6040f429 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "DELETE /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 204 len: 0 microversion: 2.1 time: 0.114379 Sep 13 01:24:47.363526 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 405/819] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:24:47 2022] DELETE /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 13 01:24:47.371707 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-af7e9236-7b0e-4704-9534-76753ebc345a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:47.372527 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-af7e9236-7b0e-4704-9534-76753ebc345a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:47.378420 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af7e9236-7b0e-4704-9534-76753ebc345a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:47.378932 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af7e9236-7b0e-4704-9534-76753ebc345a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:47.379367 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af7e9236-7b0e-4704-9534-76753ebc345a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:47.380053 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af7e9236-7b0e-4704-9534-76753ebc345a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:47.380504 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af7e9236-7b0e-4704-9534-76753ebc345a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:47.380922 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af7e9236-7b0e-4704-9534-76753ebc345a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:47.510874 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-af7e9236-7b0e-4704-9534-76753ebc345a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:47.518473 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-af7e9236-7b0e-4704-9534-76753ebc345a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1504 microversion: 2.1 time: 0.150657 Sep 13 01:24:47.519072 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 415/820] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:47 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:48.542065 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-433a1658-522f-4743-a443-a3895a21a8fe tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:48.542766 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-433a1658-522f-4743-a443-a3895a21a8fe tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:48.549717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-433a1658-522f-4743-a443-a3895a21a8fe tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:48.550195 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-433a1658-522f-4743-a443-a3895a21a8fe tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:48.550625 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-433a1658-522f-4743-a443-a3895a21a8fe tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:48.551353 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-433a1658-522f-4743-a443-a3895a21a8fe tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:48.551803 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-433a1658-522f-4743-a443-a3895a21a8fe tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:48.552220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-433a1658-522f-4743-a443-a3895a21a8fe tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:48.684131 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-433a1658-522f-4743-a443-a3895a21a8fe tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:48.691719 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-433a1658-522f-4743-a443-a3895a21a8fe tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1504 microversion: 2.1 time: 0.153858 Sep 13 01:24:48.692286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 406/821] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:48 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:49.602678 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-7f6d08c0-1c72-4784-9f3a-e0d29430f24a req-f2119cd8-0f5e-4231-96fc-c1136fceaba1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5886aa7b-f2e4-49b9-9a6b-fb4546d47372", "name": "network-vif-deleted", "tag": "f4269d77-acf2-4422-92da-6b2acc94de4e"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:49.613939 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-7f6d08c0-1c72-4784-9f3a-e0d29430f24a req-f2119cd8-0f5e-4231-96fc-c1136fceaba1 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:49.614638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-7f6d08c0-1c72-4784-9f3a-e0d29430f24a req-f2119cd8-0f5e-4231-96fc-c1136fceaba1 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:49.615161 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-7f6d08c0-1c72-4784-9f3a-e0d29430f24a req-f2119cd8-0f5e-4231-96fc-c1136fceaba1 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:49.630268 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-7f6d08c0-1c72-4784-9f3a-e0d29430f24a req-f2119cd8-0f5e-4231-96fc-c1136fceaba1 service nova] Creating event network-vif-deleted:f4269d77-acf2-4422-92da-6b2acc94de4e for instance 5886aa7b-f2e4-49b9-9a6b-fb4546d47372 on hv-cinder-85694 Sep 13 01:24:49.636468 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-7f6d08c0-1c72-4784-9f3a-e0d29430f24a req-f2119cd8-0f5e-4231-96fc-c1136fceaba1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037743 Sep 13 01:24:49.637309 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 416/822] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:24:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:49.715885 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:49.716522 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:49.722927 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:49.723412 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:49.723906 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:49.724544 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:49.724995 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:49.725454 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:49.760492 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:49.760973 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:49.761399 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:49.761844 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lazy-loading 'fault' on Instance uuid 5886aa7b-f2e4-49b9-9a6b-fb4546d47372 {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:24:49.802396 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:49.811266 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-2923f257-f45a-4f60-a3f9-543e4440cc24 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 200 len: 1304 microversion: 2.1 time: 0.100073 Sep 13 01:24:49.811818 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 407/823] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:49 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:50.835903 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4af08079-83d5-4445-a47b-63f3ea3f807f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:50.837333 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4af08079-83d5-4445-a47b-63f3ea3f807f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 5886aa7b-f2e4-49b9-9a6b-fb4546d47372] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:50.843941 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4af08079-83d5-4445-a47b-63f3ea3f807f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:50.844428 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4af08079-83d5-4445-a47b-63f3ea3f807f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:50.844869 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4af08079-83d5-4445-a47b-63f3ea3f807f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:50.845560 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4af08079-83d5-4445-a47b-63f3ea3f807f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:50.846017 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4af08079-83d5-4445-a47b-63f3ea3f807f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:50.846443 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4af08079-83d5-4445-a47b-63f3ea3f807f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:50.859591 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-4af08079-83d5-4445-a47b-63f3ea3f807f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] HTTP exception thrown: Instance 5886aa7b-f2e4-49b9-9a6b-fb4546d47372 could not be found. Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4af08079-83d5-4445-a47b-63f3ea3f807f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Request method failure captured: Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 HTTP/1.1 Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9vNupuDgR4iIMoHhQ96J__cLCg2vv9fUwwclTa6Hyw5-WP-Iz7BRUnoUbpYj7AVxMazUMQB5hF3q4k-e1BMcIKOM8DCuId6wvqQX1fY-YoolEHI_hUxU3YR5qktbeoFi4pb_BK3hUvrlqIWGWhh5bCzVeMV_jPZUWmq-cHkzicXSzM Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 99cfba5cf9d54e10ba5fc677bf713e2f Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesActionsTest-883164864 Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:24:50.861213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:24:50.862786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_99cfba5cf9d54e10ba5fc677bf713e2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/99cfba5cf9d54e10ba5fc677bf713e2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/99cfba5cf9d54e10ba5fc677bf713e2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/99cfba5cf9d54e10ba5fc677bf713e2f"}]}] Sep 13 01:24:50.862786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesActionsTest-883164864 Sep 13 01:24:50.862786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 99cfba5cf9d54e10ba5fc677bf713e2f Sep 13 01:24:50.862786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesActionsTest-883164864 Sep 13 01:24:50.862786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesActionsTest-883164864-project Sep 13 01:24:50.862786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:24:50.862786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:24:50.862786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 38ba0a3f69474e4ba60361b5c48f4579 Sep 13 01:24:50.862786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesActionsTest-883164864-project Sep 13 01:24:50.862786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:24:50.862786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 5886aa7b-f2e4-49b9-9a6b-fb4546d47372 could not be found. Sep 13 01:24:50.862786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '5886aa7b-f2e4-49b9-9a6b-fb4546d47372'} Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5886aa7b-f2e4-49b9-9a6b-fb4546d47372 could not be found. Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:24:50.863733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5886aa7b-f2e4-49b9-9a6b-fb4546d47372 could not be found. Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5886aa7b-f2e4-49b9-9a6b-fb4546d47372 could not be found. Sep 13 01:24:50.865272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:24:50.866599 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4af08079-83d5-4445-a47b-63f3ea3f807f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Returning 404 to user: Instance 5886aa7b-f2e4-49b9-9a6b-fb4546d47372 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:24:50.866599 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4af08079-83d5-4445-a47b-63f3ea3f807f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372" status: 404 len: 111 microversion: 2.1 time: 0.030977 Sep 13 01:24:50.866958 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 417/824] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:50 2022] GET /compute/v2.1/servers/5886aa7b-f2e4-49b9-9a6b-fb4546d47372 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:24:50.911408 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-453275890", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "networks": [{"uuid": "59526115-cee6-4eef-ab50-f84cd1e85872"}]}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:50.965220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.network.neutron [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] validate_networks() for [('59526115-cee6-4eef-ab50-f84cd1e85872', None, None, None, None, None)] {{(pid=120412) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:24:51.296637 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Flavor limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:24:51.297057 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Image limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:24:51.297552 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Flavor pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:24:51.297955 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Image pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:24:51.298367 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:24:51.307907 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:51.308383 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:51.308812 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:51.309551 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:51.309985 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:51.310405 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:51.327480 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Getting quotas for project 99cfba5cf9d54e10ba5fc677bf713e2f. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:24:51.332291 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Getting quotas for user 38ba0a3f69474e4ba60361b5c48f4579 and project 99cfba5cf9d54e10ba5fc677bf713e2f. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:24:51.342869 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Going to run 1 instances... {{(pid=120412) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:24:51.345133 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120412) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:24:51.390987 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-fcf90b85-b425-45b0-8fed-03cb01d3a9c0 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483173 Sep 13 01:24:51.391558 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 408/825] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:24:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 484 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 01:24:51.402670 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-67d74a26-a1cb-4f78-9508-d5136dfc555d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:51.403309 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-67d74a26-a1cb-4f78-9508-d5136dfc555d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:51.456941 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-67d74a26-a1cb-4f78-9508-d5136dfc555d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:51.463709 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-67d74a26-a1cb-4f78-9508-d5136dfc555d tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1213 microversion: 2.1 time: 0.064972 Sep 13 01:24:51.464300 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 418/826] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:51 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1213 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:52.486341 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-259416c4-f86e-4628-99ce-6f5bff8c7818 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:52.487080 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-259416c4-f86e-4628-99ce-6f5bff8c7818 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:52.493562 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-259416c4-f86e-4628-99ce-6f5bff8c7818 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:52.494066 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-259416c4-f86e-4628-99ce-6f5bff8c7818 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:52.494472 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-259416c4-f86e-4628-99ce-6f5bff8c7818 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:52.495180 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-259416c4-f86e-4628-99ce-6f5bff8c7818 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:52.495631 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-259416c4-f86e-4628-99ce-6f5bff8c7818 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:52.496073 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-259416c4-f86e-4628-99ce-6f5bff8c7818 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:52.568383 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-259416c4-f86e-4628-99ce-6f5bff8c7818 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:52.578548 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-259416c4-f86e-4628-99ce-6f5bff8c7818 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1265 microversion: 2.1 time: 0.096433 Sep 13 01:24:52.585567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 409/827] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:52 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:53.607976 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a7006266-0a52-4e10-bb1f-cfc83fe213c9 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:53.608589 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a7006266-0a52-4e10-bb1f-cfc83fe213c9 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:53.611522 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:53.617506 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a7006266-0a52-4e10-bb1f-cfc83fe213c9 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:53.617991 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a7006266-0a52-4e10-bb1f-cfc83fe213c9 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:53.618449 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a7006266-0a52-4e10-bb1f-cfc83fe213c9 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:53.619167 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a7006266-0a52-4e10-bb1f-cfc83fe213c9 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:53.619617 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a7006266-0a52-4e10-bb1f-cfc83fe213c9 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:53.620035 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a7006266-0a52-4e10-bb1f-cfc83fe213c9 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:53.755733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a7006266-0a52-4e10-bb1f-cfc83fe213c9 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:53.764042 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a7006266-0a52-4e10-bb1f-cfc83fe213c9 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1313 microversion: 2.1 time: 0.159878 Sep 13 01:24:53.764601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 419/828] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:53 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:54.086529 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-24d6878c-5a25-4f2f-a307-02c7b01522d3 req-af2524cd-e27a-41ec-aca6-1507042e29c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "625cc39b-304c-4fe1-b91d-0f532ddecf95", "tag": "fd0a95b9-3907-4b88-878d-7ddbe37619ec"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:24:54.096608 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-24d6878c-5a25-4f2f-a307-02c7b01522d3 req-af2524cd-e27a-41ec-aca6-1507042e29c3 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:54.097096 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-24d6878c-5a25-4f2f-a307-02c7b01522d3 req-af2524cd-e27a-41ec-aca6-1507042e29c3 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:54.097527 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-24d6878c-5a25-4f2f-a307-02c7b01522d3 req-af2524cd-e27a-41ec-aca6-1507042e29c3 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:54.109431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-24d6878c-5a25-4f2f-a307-02c7b01522d3 req-af2524cd-e27a-41ec-aca6-1507042e29c3 service nova] Creating event network-changed:fd0a95b9-3907-4b88-878d-7ddbe37619ec for instance 625cc39b-304c-4fe1-b91d-0f532ddecf95 on hv-cinder-85694 Sep 13 01:24:54.114184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-24d6878c-5a25-4f2f-a307-02c7b01522d3 req-af2524cd-e27a-41ec-aca6-1507042e29c3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031324 Sep 13 01:24:54.114784 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 410/829] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:54.787894 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cc59d1b3-e9d2-41cd-aa5f-e1bd1f31acaa tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:54.789067 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cc59d1b3-e9d2-41cd-aa5f-e1bd1f31acaa tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:54.797039 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc59d1b3-e9d2-41cd-aa5f-e1bd1f31acaa tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:54.797649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc59d1b3-e9d2-41cd-aa5f-e1bd1f31acaa tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:54.798188 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc59d1b3-e9d2-41cd-aa5f-e1bd1f31acaa tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:54.798937 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc59d1b3-e9d2-41cd-aa5f-e1bd1f31acaa tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:54.799400 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc59d1b3-e9d2-41cd-aa5f-e1bd1f31acaa tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:54.799828 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc59d1b3-e9d2-41cd-aa5f-e1bd1f31acaa tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:54.817626 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:54.941382 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cc59d1b3-e9d2-41cd-aa5f-e1bd1f31acaa tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:54.949179 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cc59d1b3-e9d2-41cd-aa5f-e1bd1f31acaa tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1313 microversion: 2.1 time: 0.165140 Sep 13 01:24:54.949782 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 420/830] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:54 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:24:55.493960 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1f01a6ca-a251-46ca-9bc6-4fbc6b53c34a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:55.496227 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1f01a6ca-a251-46ca-9bc6-4fbc6b53c34a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:55.502212 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1f01a6ca-a251-46ca-9bc6-4fbc6b53c34a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:55.502693 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1f01a6ca-a251-46ca-9bc6-4fbc6b53c34a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:55.503160 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1f01a6ca-a251-46ca-9bc6-4fbc6b53c34a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:55.503850 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1f01a6ca-a251-46ca-9bc6-4fbc6b53c34a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:55.504305 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1f01a6ca-a251-46ca-9bc6-4fbc6b53c34a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:55.504733 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1f01a6ca-a251-46ca-9bc6-4fbc6b53c34a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:55.534144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1f01a6ca-a251-46ca-9bc6-4fbc6b53c34a tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045561 Sep 13 01:24:55.534696 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 411/831] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:24:55 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:55.635918 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7253889d-c51d-4b28-a057-cf8313c7e4c8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:55.636412 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7253889d-c51d-4b28-a057-cf8313c7e4c8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:55.642292 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7253889d-c51d-4b28-a057-cf8313c7e4c8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:55.642774 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7253889d-c51d-4b28-a057-cf8313c7e4c8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:55.643244 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7253889d-c51d-4b28-a057-cf8313c7e4c8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:55.643934 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7253889d-c51d-4b28-a057-cf8313c7e4c8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:55.644387 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7253889d-c51d-4b28-a057-cf8313c7e4c8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:55.644815 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7253889d-c51d-4b28-a057-cf8313c7e4c8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:55.673660 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7253889d-c51d-4b28-a057-cf8313c7e4c8 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments/c8f85bb8-922f-4169-8154-d1ec8a0883f9" status: 200 len: 194 microversion: 2.1 time: 0.041704 Sep 13 01:24:55.674222 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 421/832] 10.222.0.15 () {58 vars in 1413 bytes} [Tue Sep 13 01:24:55 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments/c8f85bb8-922f-4169-8154-d1ec8a0883f9 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:55.684749 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-fb6a9a1f-346e-48f7-94f9-9b567e0cdeb2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:55.685246 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-fb6a9a1f-346e-48f7-94f9-9b567e0cdeb2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:55.691081 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fb6a9a1f-346e-48f7-94f9-9b567e0cdeb2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:55.691556 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fb6a9a1f-346e-48f7-94f9-9b567e0cdeb2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:55.691981 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fb6a9a1f-346e-48f7-94f9-9b567e0cdeb2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:55.692658 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fb6a9a1f-346e-48f7-94f9-9b567e0cdeb2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:55.693105 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fb6a9a1f-346e-48f7-94f9-9b567e0cdeb2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:55.693522 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-fb6a9a1f-346e-48f7-94f9-9b567e0cdeb2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:55.770600 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-fb6a9a1f-346e-48f7-94f9-9b567e0cdeb2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lazy-loading 'services' on Instance uuid ad33c0aa-a0d0-423b-a979-7e448b85cf2a {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:24:55.841293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-fb6a9a1f-346e-48f7-94f9-9b567e0cdeb2 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments/c8f85bb8-922f-4169-8154-d1ec8a0883f9" status: 202 len: 0 microversion: 2.1 time: 0.160520 Sep 13 01:24:55.841874 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 412/833] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 01:24:55 2022] DELETE /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments/c8f85bb8-922f-4169-8154-d1ec8a0883f9 => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:24:55.971937 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6dcc1935-0003-4191-9bd6-43b503bc48c1 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:55.972546 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6dcc1935-0003-4191-9bd6-43b503bc48c1 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:55.978872 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6dcc1935-0003-4191-9bd6-43b503bc48c1 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:55.979383 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6dcc1935-0003-4191-9bd6-43b503bc48c1 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:55.979821 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6dcc1935-0003-4191-9bd6-43b503bc48c1 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:55.980526 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6dcc1935-0003-4191-9bd6-43b503bc48c1 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:55.980977 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6dcc1935-0003-4191-9bd6-43b503bc48c1 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:55.981406 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6dcc1935-0003-4191-9bd6-43b503bc48c1 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:56.104765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6dcc1935-0003-4191-9bd6-43b503bc48c1 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:56.112314 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6dcc1935-0003-4191-9bd6-43b503bc48c1 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1313 microversion: 2.1 time: 0.144272 Sep 13 01:24:56.112865 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 422/834] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:55 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1313 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:57.135975 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f08b4d56-c655-4d19-8559-8c3a7d0dabb8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:57.136673 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-f08b4d56-c655-4d19-8559-8c3a7d0dabb8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:57.142785 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f08b4d56-c655-4d19-8559-8c3a7d0dabb8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:57.143293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f08b4d56-c655-4d19-8559-8c3a7d0dabb8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:57.143731 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f08b4d56-c655-4d19-8559-8c3a7d0dabb8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:57.144415 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f08b4d56-c655-4d19-8559-8c3a7d0dabb8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:57.144867 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f08b4d56-c655-4d19-8559-8c3a7d0dabb8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:57.145286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f08b4d56-c655-4d19-8559-8c3a7d0dabb8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:57.272184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f08b4d56-c655-4d19-8559-8c3a7d0dabb8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:57.280083 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f08b4d56-c655-4d19-8559-8c3a7d0dabb8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1313 microversion: 2.1 time: 0.149397 Sep 13 01:24:57.280668 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 413/835] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:57 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:58.018962 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-da90ffea-1a85-485a-b022-5a8707e870c1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:58.019459 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-da90ffea-1a85-485a-b022-5a8707e870c1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:58.026400 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da90ffea-1a85-485a-b022-5a8707e870c1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:58.026905 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da90ffea-1a85-485a-b022-5a8707e870c1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:58.027341 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da90ffea-1a85-485a-b022-5a8707e870c1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:58.028031 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da90ffea-1a85-485a-b022-5a8707e870c1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:58.028484 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da90ffea-1a85-485a-b022-5a8707e870c1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:58.028910 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-da90ffea-1a85-485a-b022-5a8707e870c1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:58.057434 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-da90ffea-1a85-485a-b022-5a8707e870c1 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments/3e467279-88a8-4888-ad98-65ba2c1c0e33" status: 200 len: 194 microversion: 2.1 time: 0.042416 Sep 13 01:24:58.057991 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 423/836] 10.222.0.15 () {58 vars in 1413 bytes} [Tue Sep 13 01:24:58 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments/3e467279-88a8-4888-ad98-65ba2c1c0e33 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:24:58.068320 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ed790598-4435-4b11-bd71-d3c5243d4dc5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:58.068818 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ed790598-4435-4b11-bd71-d3c5243d4dc5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:58.071303 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:58.076433 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed790598-4435-4b11-bd71-d3c5243d4dc5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:58.076922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed790598-4435-4b11-bd71-d3c5243d4dc5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:58.077357 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed790598-4435-4b11-bd71-d3c5243d4dc5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:58.078049 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed790598-4435-4b11-bd71-d3c5243d4dc5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:58.078500 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed790598-4435-4b11-bd71-d3c5243d4dc5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:58.078954 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ed790598-4435-4b11-bd71-d3c5243d4dc5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:58.164544 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-ed790598-4435-4b11-bd71-d3c5243d4dc5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lazy-loading 'services' on Instance uuid ad33c0aa-a0d0-423b-a979-7e448b85cf2a {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:24:58.236732 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ed790598-4435-4b11-bd71-d3c5243d4dc5 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments/3e467279-88a8-4888-ad98-65ba2c1c0e33" status: 202 len: 0 microversion: 2.1 time: 0.172093 Sep 13 01:24:58.237327 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 414/837] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 01:24:58 2022] DELETE /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments/3e467279-88a8-4888-ad98-65ba2c1c0e33 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:24:58.302160 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1f047352-257d-4467-a028-fdc88fb6856f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:58.302866 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1f047352-257d-4467-a028-fdc88fb6856f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:58.309402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f047352-257d-4467-a028-fdc88fb6856f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:58.309882 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f047352-257d-4467-a028-fdc88fb6856f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:58.310316 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f047352-257d-4467-a028-fdc88fb6856f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:58.311051 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f047352-257d-4467-a028-fdc88fb6856f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:58.311685 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f047352-257d-4467-a028-fdc88fb6856f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:58.312236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1f047352-257d-4467-a028-fdc88fb6856f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:58.448966 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1f047352-257d-4467-a028-fdc88fb6856f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:58.456485 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1f047352-257d-4467-a028-fdc88fb6856f tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1313 microversion: 2.1 time: 0.158104 Sep 13 01:24:58.457049 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 424/838] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:58 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:59.410624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3d949aa1-de9f-4fd0-8295-b8ef8e7095da tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:59.412968 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3d949aa1-de9f-4fd0-8295-b8ef8e7095da tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:59.419675 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3d949aa1-de9f-4fd0-8295-b8ef8e7095da tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:59.420150 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3d949aa1-de9f-4fd0-8295-b8ef8e7095da tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:59.420575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3d949aa1-de9f-4fd0-8295-b8ef8e7095da tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:59.421253 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3d949aa1-de9f-4fd0-8295-b8ef8e7095da tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:59.421701 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3d949aa1-de9f-4fd0-8295-b8ef8e7095da tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:59.422115 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3d949aa1-de9f-4fd0-8295-b8ef8e7095da tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:59.451046 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3d949aa1-de9f-4fd0-8295-b8ef8e7095da tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044622 Sep 13 01:24:59.451593 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 415/839] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:24:59 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 01:24:59.478506 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-af4f6553-f6a0-4ed6-830e-d832a0783a2c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:59.479144 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-af4f6553-f6a0-4ed6-830e-d832a0783a2c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:59.485282 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af4f6553-f6a0-4ed6-830e-d832a0783a2c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:59.485763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af4f6553-f6a0-4ed6-830e-d832a0783a2c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:59.486192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af4f6553-f6a0-4ed6-830e-d832a0783a2c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:59.486879 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af4f6553-f6a0-4ed6-830e-d832a0783a2c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:59.487401 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af4f6553-f6a0-4ed6-830e-d832a0783a2c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:59.487809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af4f6553-f6a0-4ed6-830e-d832a0783a2c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:59.568119 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4aa7843c-c2e5-4969-9988-de5ac2971f9c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:59.570588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4aa7843c-c2e5-4969-9988-de5ac2971f9c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:59.576522 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4aa7843c-c2e5-4969-9988-de5ac2971f9c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:59.577008 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4aa7843c-c2e5-4969-9988-de5ac2971f9c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:59.577444 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4aa7843c-c2e5-4969-9988-de5ac2971f9c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:59.578138 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4aa7843c-c2e5-4969-9988-de5ac2971f9c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:59.578622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4aa7843c-c2e5-4969-9988-de5ac2971f9c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:59.579074 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4aa7843c-c2e5-4969-9988-de5ac2971f9c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:59.604256 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:24:59.608931 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4aa7843c-c2e5-4969-9988-de5ac2971f9c tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044728 Sep 13 01:24:59.609510 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 416/840] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:24:59 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 13 01:24:59.615885 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-af4f6553-f6a0-4ed6-830e-d832a0783a2c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:59.624602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-af4f6553-f6a0-4ed6-830e-d832a0783a2c tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1313 microversion: 2.1 time: 0.149954 Sep 13 01:24:59.625162 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 425/841] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:59 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:24:59.672710 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-779fa4c2-cc15-4953-97e1-8cd508a30f5f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:59.673206 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-779fa4c2-cc15-4953-97e1-8cd508a30f5f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:59.680574 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-779fa4c2-cc15-4953-97e1-8cd508a30f5f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:59.681316 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-779fa4c2-cc15-4953-97e1-8cd508a30f5f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:59.681752 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-779fa4c2-cc15-4953-97e1-8cd508a30f5f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:59.682440 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-779fa4c2-cc15-4953-97e1-8cd508a30f5f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:59.682915 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-779fa4c2-cc15-4953-97e1-8cd508a30f5f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:59.683342 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-779fa4c2-cc15-4953-97e1-8cd508a30f5f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:59.707848 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-779fa4c2-cc15-4953-97e1-8cd508a30f5f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Going to try to terminate instance {{(pid=120412) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:24:59.789765 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-779fa4c2-cc15-4953-97e1-8cd508a30f5f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 204 len: 0 microversion: 2.1 time: 0.120040 Sep 13 01:24:59.790442 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 417/842] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:24:59 2022] DELETE /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:24:59.798991 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-9cd6736d-c06b-433c-845c-82924ac9642f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:24:59.799607 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-9cd6736d-c06b-433c-845c-82924ac9642f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:24:59.806382 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9cd6736d-c06b-433c-845c-82924ac9642f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:59.806878 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9cd6736d-c06b-433c-845c-82924ac9642f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:59.807401 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9cd6736d-c06b-433c-845c-82924ac9642f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:59.808095 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9cd6736d-c06b-433c-845c-82924ac9642f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:24:59.808577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9cd6736d-c06b-433c-845c-82924ac9642f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:24:59.809057 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-9cd6736d-c06b-433c-845c-82924ac9642f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:24:59.941001 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-9cd6736d-c06b-433c-845c-82924ac9642f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:24:59.948944 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-9cd6736d-c06b-433c-845c-82924ac9642f tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1672 microversion: 2.1 time: 0.153965 Sep 13 01:24:59.949532 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 426/843] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:24:59 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:00.262281 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-7bdfdbf0-cebd-43dd-b066-9aa8b796eb72 req-b94ddab5-57c4-474b-a621-1b42f989fcce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625cc39b-304c-4fe1-b91d-0f532ddecf95", "name": "network-vif-plugged", "status": "completed", "tag": "fd0a95b9-3907-4b88-878d-7ddbe37619ec"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:00.272341 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-7bdfdbf0-cebd-43dd-b066-9aa8b796eb72 req-b94ddab5-57c4-474b-a621-1b42f989fcce service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:00.272823 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-7bdfdbf0-cebd-43dd-b066-9aa8b796eb72 req-b94ddab5-57c4-474b-a621-1b42f989fcce service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:00.273795 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-7bdfdbf0-cebd-43dd-b066-9aa8b796eb72 req-b94ddab5-57c4-474b-a621-1b42f989fcce service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:00.284869 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-7bdfdbf0-cebd-43dd-b066-9aa8b796eb72 req-b94ddab5-57c4-474b-a621-1b42f989fcce service nova] Creating event network-vif-plugged:fd0a95b9-3907-4b88-878d-7ddbe37619ec for instance 625cc39b-304c-4fe1-b91d-0f532ddecf95 on hv-cinder-85694 Sep 13 01:25:00.290346 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-7bdfdbf0-cebd-43dd-b066-9aa8b796eb72 req-b94ddab5-57c4-474b-a621-1b42f989fcce service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031329 Sep 13 01:25:00.290986 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 418/844] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:00.646666 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-18012dcb-0b28-47b1-aed8-bdc852661e7e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:00.647304 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-18012dcb-0b28-47b1-aed8-bdc852661e7e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:00.654285 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18012dcb-0b28-47b1-aed8-bdc852661e7e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:00.654765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18012dcb-0b28-47b1-aed8-bdc852661e7e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:00.655234 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18012dcb-0b28-47b1-aed8-bdc852661e7e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:00.655914 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18012dcb-0b28-47b1-aed8-bdc852661e7e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:00.656362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18012dcb-0b28-47b1-aed8-bdc852661e7e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:00.656780 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18012dcb-0b28-47b1-aed8-bdc852661e7e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:00.782372 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-18012dcb-0b28-47b1-aed8-bdc852661e7e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:00.792884 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-18012dcb-0b28-47b1-aed8-bdc852661e7e tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1313 microversion: 2.1 time: 0.149980 Sep 13 01:25:00.793466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 427/845] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:00 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:00.974021 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b7c051ee-a0ac-4a2c-af2f-4a1345ad9bae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:00.974714 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b7c051ee-a0ac-4a2c-af2f-4a1345ad9bae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:00.980771 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b7c051ee-a0ac-4a2c-af2f-4a1345ad9bae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:00.981254 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b7c051ee-a0ac-4a2c-af2f-4a1345ad9bae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:00.981738 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b7c051ee-a0ac-4a2c-af2f-4a1345ad9bae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:00.982366 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b7c051ee-a0ac-4a2c-af2f-4a1345ad9bae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:00.982819 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b7c051ee-a0ac-4a2c-af2f-4a1345ad9bae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:00.983262 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b7c051ee-a0ac-4a2c-af2f-4a1345ad9bae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:01.110322 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b7c051ee-a0ac-4a2c-af2f-4a1345ad9bae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:01.118590 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b7c051ee-a0ac-4a2c-af2f-4a1345ad9bae tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1672 microversion: 2.1 time: 0.149197 Sep 13 01:25:01.119187 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 419/846] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:00 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1672 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:01.818832 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fa1f4d8d-7e5d-47bd-a98b-f9ca32ec296a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:01.819466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fa1f4d8d-7e5d-47bd-a98b-f9ca32ec296a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:01.822173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:01.828791 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fa1f4d8d-7e5d-47bd-a98b-f9ca32ec296a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:01.829280 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fa1f4d8d-7e5d-47bd-a98b-f9ca32ec296a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:01.829720 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fa1f4d8d-7e5d-47bd-a98b-f9ca32ec296a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:01.830430 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fa1f4d8d-7e5d-47bd-a98b-f9ca32ec296a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:01.830901 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fa1f4d8d-7e5d-47bd-a98b-f9ca32ec296a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:01.831326 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fa1f4d8d-7e5d-47bd-a98b-f9ca32ec296a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:01.961035 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fa1f4d8d-7e5d-47bd-a98b-f9ca32ec296a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:01.968607 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fa1f4d8d-7e5d-47bd-a98b-f9ca32ec296a tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1313 microversion: 2.1 time: 0.153681 Sep 13 01:25:01.969168 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 428/847] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:01 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:02.142651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b4a41bdd-82c4-408b-bdd0-7d9b8127bebe tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:02.143303 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b4a41bdd-82c4-408b-bdd0-7d9b8127bebe tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:02.145277 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:02.145991 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=6 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:02.152421 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b4a41bdd-82c4-408b-bdd0-7d9b8127bebe tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:02.152916 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b4a41bdd-82c4-408b-bdd0-7d9b8127bebe tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:02.153356 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b4a41bdd-82c4-408b-bdd0-7d9b8127bebe tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:02.154066 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b4a41bdd-82c4-408b-bdd0-7d9b8127bebe tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:02.154524 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b4a41bdd-82c4-408b-bdd0-7d9b8127bebe tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:02.154974 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b4a41bdd-82c4-408b-bdd0-7d9b8127bebe tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:02.414072 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b4a41bdd-82c4-408b-bdd0-7d9b8127bebe tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:02.422772 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b4a41bdd-82c4-408b-bdd0-7d9b8127bebe tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1672 microversion: 2.1 time: 0.284565 Sep 13 01:25:02.423460 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 420/848] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:02 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1672 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:02.753861 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-e9b4190c-fc93-4dfb-82b4-dd2a7f36d4e8 req-b962659f-5b13-4dc9-bedd-16d71da63287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ad33c0aa-a0d0-423b-a979-7e448b85cf2a", "name": "network-vif-deleted", "tag": "6a0f0882-0ddc-43dd-a35a-31a905ab84e6"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:02.764909 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-e9b4190c-fc93-4dfb-82b4-dd2a7f36d4e8 req-b962659f-5b13-4dc9-bedd-16d71da63287 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:02.765424 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-e9b4190c-fc93-4dfb-82b4-dd2a7f36d4e8 req-b962659f-5b13-4dc9-bedd-16d71da63287 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:02.765850 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-e9b4190c-fc93-4dfb-82b4-dd2a7f36d4e8 req-b962659f-5b13-4dc9-bedd-16d71da63287 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:02.778345 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-e9b4190c-fc93-4dfb-82b4-dd2a7f36d4e8 req-b962659f-5b13-4dc9-bedd-16d71da63287 service nova] Creating event network-vif-deleted:6a0f0882-0ddc-43dd-a35a-31a905ab84e6 for instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a on hv-cinder-85694 Sep 13 01:25:02.784421 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-e9b4190c-fc93-4dfb-82b4-dd2a7f36d4e8 req-b962659f-5b13-4dc9-bedd-16d71da63287 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034344 Sep 13 01:25:02.785011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 429/849] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:02.991689 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-535d3919-fd21-44cf-a457-eda95584aa25 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:02.992493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-535d3919-fd21-44cf-a457-eda95584aa25 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:02.998587 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-535d3919-fd21-44cf-a457-eda95584aa25 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:02.999191 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-535d3919-fd21-44cf-a457-eda95584aa25 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:02.999687 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-535d3919-fd21-44cf-a457-eda95584aa25 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:03.000442 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-535d3919-fd21-44cf-a457-eda95584aa25 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:03.000960 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-535d3919-fd21-44cf-a457-eda95584aa25 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:03.001449 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-535d3919-fd21-44cf-a457-eda95584aa25 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:03.130218 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-535d3919-fd21-44cf-a457-eda95584aa25 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:03.138004 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-535d3919-fd21-44cf-a457-eda95584aa25 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1313 microversion: 2.1 time: 0.150302 Sep 13 01:25:03.138576 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 421/850] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:02 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:25:03.448833 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:03.449542 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:03.456408 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:03.456912 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:03.457356 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:03.458107 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:03.458570 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:03.459030 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:03.522392 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:03.522913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:03.524013 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:03.524518 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lazy-loading 'fault' on Instance uuid ad33c0aa-a0d0-423b-a979-7e448b85cf2a {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:25:03.570488 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '349e19300f1e48c3ac44fc34611c7f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9056ec686513412a87c292387e25e870', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:03.579883 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c9cd097a-ec5a-43f1-9b48-32ece2bee25e tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 200 len: 1327 microversion: 2.1 time: 0.135102 Sep 13 01:25:03.581299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 430/851] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:03 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 1327 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:04.161407 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d206abbd-d80b-49a2-a06d-d378d9183896 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:04.162019 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d206abbd-d80b-49a2-a06d-d378d9183896 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:04.168900 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d206abbd-d80b-49a2-a06d-d378d9183896 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:04.169364 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d206abbd-d80b-49a2-a06d-d378d9183896 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:04.169800 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d206abbd-d80b-49a2-a06d-d378d9183896 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:04.170517 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d206abbd-d80b-49a2-a06d-d378d9183896 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:04.171006 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d206abbd-d80b-49a2-a06d-d378d9183896 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:04.171430 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d206abbd-d80b-49a2-a06d-d378d9183896 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:04.301926 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d206abbd-d80b-49a2-a06d-d378d9183896 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:04.310528 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d206abbd-d80b-49a2-a06d-d378d9183896 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1497 microversion: 2.1 time: 0.153420 Sep 13 01:25:04.311124 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 422/852] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:04 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:25:04.608046 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-202c7349-48dd-436f-86ad-e4396cac0b62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:04.608663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-202c7349-48dd-436f-86ad-e4396cac0b62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:04.614812 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-202c7349-48dd-436f-86ad-e4396cac0b62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:04.615336 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-202c7349-48dd-436f-86ad-e4396cac0b62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:04.615769 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-202c7349-48dd-436f-86ad-e4396cac0b62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:04.616616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-202c7349-48dd-436f-86ad-e4396cac0b62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:04.617110 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-202c7349-48dd-436f-86ad-e4396cac0b62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:04.617529 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-202c7349-48dd-436f-86ad-e4396cac0b62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:04.630770 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-202c7349-48dd-436f-86ad-e4396cac0b62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] HTTP exception thrown: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-202c7349-48dd-436f-86ad-e4396cac0b62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Request method failure captured: Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a HTTP/1.1 Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9pvh40nDQ7g0KDNIPvORUr0smXyn_a8EcB09L9t5ZYs6h-by3z3aSE_AXGz83-pX54TofZ_8CuYUqOd_8qmFVtD1HGtEnI5HWK64ftQV48tZn2FZS5hRN0kjchMampfCqgFfxC1_gQRj4ZU7LWcd_C_bolEfAWAV4ntXABiEUjE_44 Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 9056ec686513412a87c292387e25e870 Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:25:04.632431 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:25:04.634019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9056ec686513412a87c292387e25e870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9056ec686513412a87c292387e25e870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9056ec686513412a87c292387e25e870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9056ec686513412a87c292387e25e870"}]}] Sep 13 01:25:04.634019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:04.634019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 9056ec686513412a87c292387e25e870 Sep 13 01:25:04.634019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:04.634019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeTestJSON-1146747367-project Sep 13 01:25:04.634019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:25:04.634019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:25:04.634019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 349e19300f1e48c3ac44fc34611c7f4a Sep 13 01:25:04.634019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeTestJSON-1146747367-project Sep 13 01:25:04.634019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:25:04.634019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:04.634019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': 'ad33c0aa-a0d0-423b-a979-7e448b85cf2a'} Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:04.635313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:04.636755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:04.638143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-202c7349-48dd-436f-86ad-e4396cac0b62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Returning 404 to user: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:04.638143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-202c7349-48dd-436f-86ad-e4396cac0b62 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 404 len: 111 microversion: 2.1 time: 0.029705 Sep 13 01:25:04.638143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 431/853] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:04 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:04.642597 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-71540725-3465-4bd9-9ee4-6afe135b9ebc tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '.version_select at 0x7fb05e234ca0>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:04.661059 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-71540725-3465-4bd9-9ee4-6afe135b9ebc tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362496119" status: 202 len: 0 microversion: 2.1 time: 0.022143 Sep 13 01:25:04.661622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 423/854] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Sep 13 01:25:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1362496119 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:25:04.781870 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-236c5ab2-73f5-412e-a879-f28b857440b8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:04.782574 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-236c5ab2-73f5-412e-a879-f28b857440b8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:04.788755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-236c5ab2-73f5-412e-a879-f28b857440b8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:04.789981 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-236c5ab2-73f5-412e-a879-f28b857440b8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:04.790445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-236c5ab2-73f5-412e-a879-f28b857440b8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:04.791212 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-236c5ab2-73f5-412e-a879-f28b857440b8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:04.791715 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-236c5ab2-73f5-412e-a879-f28b857440b8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:04.792227 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-236c5ab2-73f5-412e-a879-f28b857440b8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:04.829535 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-236c5ab2-73f5-412e-a879-f28b857440b8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:25:04.909169 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-236c5ab2-73f5-412e-a879-f28b857440b8 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "DELETE /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 204 len: 0 microversion: 2.1 time: 0.131330 Sep 13 01:25:04.910150 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 432/855] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:25:04 2022] DELETE /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:25:04.919053 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-47f1a0e0-9cfd-4e44-b093-882f9bc7a6d2 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:04.920104 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-47f1a0e0-9cfd-4e44-b093-882f9bc7a6d2 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:04.926526 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-47f1a0e0-9cfd-4e44-b093-882f9bc7a6d2 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:04.927142 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-47f1a0e0-9cfd-4e44-b093-882f9bc7a6d2 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:04.928405 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-47f1a0e0-9cfd-4e44-b093-882f9bc7a6d2 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:04.930300 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-47f1a0e0-9cfd-4e44-b093-882f9bc7a6d2 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:04.931416 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-47f1a0e0-9cfd-4e44-b093-882f9bc7a6d2 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:04.931941 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-47f1a0e0-9cfd-4e44-b093-882f9bc7a6d2 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:05.263595 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-47f1a0e0-9cfd-4e44-b093-882f9bc7a6d2 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:05.271479 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-47f1a0e0-9cfd-4e44-b093-882f9bc7a6d2 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1503 microversion: 2.1 time: 0.357035 Sep 13 01:25:05.272051 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 424/856] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:04 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1503 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:06.294822 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-78548932-fff9-4a60-8c7f-b901c10c53e3 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:06.295527 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-78548932-fff9-4a60-8c7f-b901c10c53e3 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:06.301650 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-78548932-fff9-4a60-8c7f-b901c10c53e3 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:06.302125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-78548932-fff9-4a60-8c7f-b901c10c53e3 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:06.302551 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-78548932-fff9-4a60-8c7f-b901c10c53e3 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:06.303260 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-78548932-fff9-4a60-8c7f-b901c10c53e3 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:06.303703 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-78548932-fff9-4a60-8c7f-b901c10c53e3 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:06.304118 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-78548932-fff9-4a60-8c7f-b901c10c53e3 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:06.435329 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-78548932-fff9-4a60-8c7f-b901c10c53e3 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:06.442814 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-78548932-fff9-4a60-8c7f-b901c10c53e3 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1503 microversion: 2.1 time: 0.152167 Sep 13 01:25:06.443397 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 433/857] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:06 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:06.976928 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-b88ba9b3-69a1-4faf-aaf0-1d642abc19c8 req-f630fe3b-ad31-46ec-8608-43ce2d155c89 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "625cc39b-304c-4fe1-b91d-0f532ddecf95", "name": "network-vif-deleted", "tag": "fd0a95b9-3907-4b88-878d-7ddbe37619ec"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:06.987343 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-b88ba9b3-69a1-4faf-aaf0-1d642abc19c8 req-f630fe3b-ad31-46ec-8608-43ce2d155c89 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:06.988306 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-b88ba9b3-69a1-4faf-aaf0-1d642abc19c8 req-f630fe3b-ad31-46ec-8608-43ce2d155c89 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:06.988819 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-b88ba9b3-69a1-4faf-aaf0-1d642abc19c8 req-f630fe3b-ad31-46ec-8608-43ce2d155c89 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:07.001244 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-b88ba9b3-69a1-4faf-aaf0-1d642abc19c8 req-f630fe3b-ad31-46ec-8608-43ce2d155c89 service nova] Creating event network-vif-deleted:fd0a95b9-3907-4b88-878d-7ddbe37619ec for instance 625cc39b-304c-4fe1-b91d-0f532ddecf95 on hv-cinder-85694 Sep 13 01:25:07.005963 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-b88ba9b3-69a1-4faf-aaf0-1d642abc19c8 req-f630fe3b-ad31-46ec-8608-43ce2d155c89 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033174 Sep 13 01:25:07.006567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 425/858] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:07.472485 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:07.473349 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:07.481220 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:07.481699 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:07.482151 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:07.482833 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:07.483391 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:07.483809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:07.514558 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:07.515076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:07.515517 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:07.515970 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lazy-loading 'fault' on Instance uuid 625cc39b-304c-4fe1-b91d-0f532ddecf95 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:25:07.561349 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '38ba0a3f69474e4ba60361b5c48f4579', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '99cfba5cf9d54e10ba5fc677bf713e2f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:07.569661 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1da6a770-5992-45bf-b554-c243883aa993 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 200 len: 1303 microversion: 2.1 time: 0.106939 Sep 13 01:25:07.570236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 434/859] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:07 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 1303 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:07.655997 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-530f2779-eb21-461f-87c7-dce77e2873ab tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:07.656574 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-530f2779-eb21-461f-87c7-dce77e2873ab tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:07.662566 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-530f2779-eb21-461f-87c7-dce77e2873ab tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:07.663028 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-530f2779-eb21-461f-87c7-dce77e2873ab tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:07.663464 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-530f2779-eb21-461f-87c7-dce77e2873ab tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:07.664146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-530f2779-eb21-461f-87c7-dce77e2873ab tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:07.665275 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-530f2779-eb21-461f-87c7-dce77e2873ab tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:07.665693 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-530f2779-eb21-461f-87c7-dce77e2873ab tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:07.678363 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-530f2779-eb21-461f-87c7-dce77e2873ab tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] HTTP exception thrown: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-530f2779-eb21-461f-87c7-dce77e2873ab tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Request method failure captured: Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: DELETE /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a HTTP/1.1 Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9pvh40nDQ7g0KDNIPvORUr0smXyn_a8EcB09L9t5ZYs6h-by3z3aSE_AXGz83-pX54TofZ_8CuYUqOd_8qmFVtD1HGtEnI5HWK64ftQV48tZn2FZS5hRN0kjchMampfCqgFfxC1_gQRj4ZU7LWcd_C_bolEfAWAV4ntXABiEUjE_44 Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 9056ec686513412a87c292387e25e870 Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:07.680055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:07.681930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9056ec686513412a87c292387e25e870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9056ec686513412a87c292387e25e870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9056ec686513412a87c292387e25e870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9056ec686513412a87c292387e25e870"}]}] Sep 13 01:25:07.681930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:07.681930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 9056ec686513412a87c292387e25e870 Sep 13 01:25:07.681930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:07.681930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-AttachVolumeTestJSON-1146747367-project Sep 13 01:25:07.681930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:07.681930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:07.681930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 349e19300f1e48c3ac44fc34611c7f4a Sep 13 01:25:07.681930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-AttachVolumeTestJSON-1146747367-project Sep 13 01:25:07.681930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:25:07.681930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:07.681930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': 'ad33c0aa-a0d0-423b-a979-7e448b85cf2a'} Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:07.683035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:07.684567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:07.686104 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-530f2779-eb21-461f-87c7-dce77e2873ab tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Returning 404 to user: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:07.686104 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-530f2779-eb21-461f-87c7-dce77e2873ab tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 404 len: 111 microversion: 2.1 time: 0.030106 Sep 13 01:25:07.686104 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 426/860] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:25:07 2022] DELETE /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:07.689914 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cc971221-4718-4930-a023-f5968ac79ece tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:07.690530 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cc971221-4718-4930-a023-f5968ac79ece tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: ad33c0aa-a0d0-423b-a979-7e448b85cf2a] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:07.696638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc971221-4718-4930-a023-f5968ac79ece tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:07.697124 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc971221-4718-4930-a023-f5968ac79ece tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:07.697554 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc971221-4718-4930-a023-f5968ac79ece tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:07.698244 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc971221-4718-4930-a023-f5968ac79ece tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:07.698697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc971221-4718-4930-a023-f5968ac79ece tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:07.699147 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc971221-4718-4930-a023-f5968ac79ece tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:07.712856 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-cc971221-4718-4930-a023-f5968ac79ece tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] HTTP exception thrown: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cc971221-4718-4930-a023-f5968ac79ece tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Request method failure captured: Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a HTTP/1.1 Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9pvh40nDQ7g0KDNIPvORUr0smXyn_a8EcB09L9t5ZYs6h-by3z3aSE_AXGz83-pX54TofZ_8CuYUqOd_8qmFVtD1HGtEnI5HWK64ftQV48tZn2FZS5hRN0kjchMampfCqgFfxC1_gQRj4ZU7LWcd_C_bolEfAWAV4ntXABiEUjE_44 Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 9056ec686513412a87c292387e25e870 Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:25:07.714499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:25:07.716099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9056ec686513412a87c292387e25e870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9056ec686513412a87c292387e25e870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9056ec686513412a87c292387e25e870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9056ec686513412a87c292387e25e870"}]}] Sep 13 01:25:07.716099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:07.716099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 9056ec686513412a87c292387e25e870 Sep 13 01:25:07.716099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:07.716099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeTestJSON-1146747367-project Sep 13 01:25:07.716099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:25:07.716099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:25:07.716099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 349e19300f1e48c3ac44fc34611c7f4a Sep 13 01:25:07.716099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeTestJSON-1146747367-project Sep 13 01:25:07.716099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:25:07.716099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:07.716099 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': 'ad33c0aa-a0d0-423b-a979-7e448b85cf2a'} Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:07.717236 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. Sep 13 01:25:07.718649 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:07.720172 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cc971221-4718-4930-a023-f5968ac79ece tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Returning 404 to user: Instance ad33c0aa-a0d0-423b-a979-7e448b85cf2a could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:07.720172 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cc971221-4718-4930-a023-f5968ac79ece tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a" status: 404 len: 111 microversion: 2.1 time: 0.029853 Sep 13 01:25:07.720172 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 435/861] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:07 2022] GET /compute/v2.1/servers/ad33c0aa-a0d0-423b-a979-7e448b85cf2a => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:08.592328 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9ee686a7-c703-4a3c-b643-c50b9c178082 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:08.592942 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9ee686a7-c703-4a3c-b643-c50b9c178082 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] [instance: 625cc39b-304c-4fe1-b91d-0f532ddecf95] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:08.599316 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ee686a7-c703-4a3c-b643-c50b9c178082 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:08.599799 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ee686a7-c703-4a3c-b643-c50b9c178082 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:08.600235 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ee686a7-c703-4a3c-b643-c50b9c178082 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:08.600922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ee686a7-c703-4a3c-b643-c50b9c178082 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:08.601371 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ee686a7-c703-4a3c-b643-c50b9c178082 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:08.602319 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9ee686a7-c703-4a3c-b643-c50b9c178082 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:08.615416 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-9ee686a7-c703-4a3c-b643-c50b9c178082 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] HTTP exception thrown: Instance 625cc39b-304c-4fe1-b91d-0f532ddecf95 could not be found. Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9ee686a7-c703-4a3c-b643-c50b9c178082 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Request method failure captured: Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 HTTP/1.1 Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9vNupuDgR4iIMoHhQ96J__cLCg2vv9fUwwclTa6Hyw5-WP-Iz7BRUnoUbpYj7AVxMazUMQB5hF3q4k-e1BMcIKOM8DCuId6wvqQX1fY-YoolEHI_hUxU3YR5qktbeoFi4pb_BK3hUvrlqIWGWhh5bCzVeMV_jPZUWmq-cHkzicXSzM Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 99cfba5cf9d54e10ba5fc677bf713e2f Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-VolumesActionsTest-883164864 Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:08.616939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:08.619045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_99cfba5cf9d54e10ba5fc677bf713e2f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/99cfba5cf9d54e10ba5fc677bf713e2f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/99cfba5cf9d54e10ba5fc677bf713e2f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/99cfba5cf9d54e10ba5fc677bf713e2f"}]}] Sep 13 01:25:08.619045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-VolumesActionsTest-883164864 Sep 13 01:25:08.619045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 99cfba5cf9d54e10ba5fc677bf713e2f Sep 13 01:25:08.619045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-VolumesActionsTest-883164864 Sep 13 01:25:08.619045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-VolumesActionsTest-883164864-project Sep 13 01:25:08.619045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:08.619045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:08.619045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 38ba0a3f69474e4ba60361b5c48f4579 Sep 13 01:25:08.619045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-VolumesActionsTest-883164864-project Sep 13 01:25:08.619045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:25:08.619045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 625cc39b-304c-4fe1-b91d-0f532ddecf95 could not be found. Sep 13 01:25:08.619045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '625cc39b-304c-4fe1-b91d-0f532ddecf95'} Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 625cc39b-304c-4fe1-b91d-0f532ddecf95 could not be found. Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:08.619821 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 625cc39b-304c-4fe1-b91d-0f532ddecf95 could not be found. Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 625cc39b-304c-4fe1-b91d-0f532ddecf95 could not be found. Sep 13 01:25:08.621350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.622694 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9ee686a7-c703-4a3c-b643-c50b9c178082 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] Returning 404 to user: Instance 625cc39b-304c-4fe1-b91d-0f532ddecf95 could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:08.622694 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9ee686a7-c703-4a3c-b643-c50b9c178082 tempest-VolumesActionsTest-883164864 tempest-VolumesActionsTest-883164864-project] 10.222.0.15 "GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95" status: 404 len: 111 microversion: 2.1 time: 0.030550 Sep 13 01:25:08.622694 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 427/862] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:08 2022] GET /compute/v2.1/servers/625cc39b-304c-4fe1-b91d-0f532ddecf95 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:08.855258 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-12f77e79-50e0-47dc-b496-6f8825a90827 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:08.855784 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-12f77e79-50e0-47dc-b496-6f8825a90827 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:08.862468 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-12f77e79-50e0-47dc-b496-6f8825a90827 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:08.862995 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-12f77e79-50e0-47dc-b496-6f8825a90827 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:08.863513 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-12f77e79-50e0-47dc-b496-6f8825a90827 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:08.864105 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-12f77e79-50e0-47dc-b496-6f8825a90827 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:08.864558 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-12f77e79-50e0-47dc-b496-6f8825a90827 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:08.864976 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-12f77e79-50e0-47dc-b496-6f8825a90827 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:08.878741 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-12f77e79-50e0-47dc-b496-6f8825a90827 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] HTTP exception thrown: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-12f77e79-50e0-47dc-b496-6f8825a90827 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Request method failure captured: Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 HTTP/1.1 Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9pvh40nDQ7g0KDNIPvORUr0smXyn_a8EcB09L9t5ZYs6h-by3z3aSE_AXGz83-pX54TofZ_8CuYUqOd_8qmFVtD1HGtEnI5HWK64ftQV48tZn2FZS5hRN0kjchMampfCqgFfxC1_gQRj4ZU7LWcd_C_bolEfAWAV4ntXABiEUjE_44 Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 9056ec686513412a87c292387e25e870 Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:25:08.880288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:25:08.881829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9056ec686513412a87c292387e25e870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9056ec686513412a87c292387e25e870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9056ec686513412a87c292387e25e870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9056ec686513412a87c292387e25e870"}]}] Sep 13 01:25:08.881829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:08.881829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 9056ec686513412a87c292387e25e870 Sep 13 01:25:08.881829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:08.881829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeTestJSON-1146747367-project Sep 13 01:25:08.881829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:25:08.881829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:25:08.881829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 349e19300f1e48c3ac44fc34611c7f4a Sep 13 01:25:08.881829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeTestJSON-1146747367-project Sep 13 01:25:08.881829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:25:08.881829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:25:08.881829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '85de1ecb-9d12-49d4-b0cd-4631e36357d3'} Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:08.882738 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:25:08.884235 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.885656 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-12f77e79-50e0-47dc-b496-6f8825a90827 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Returning 404 to user: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:08.885656 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-12f77e79-50e0-47dc-b496-6f8825a90827 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "DELETE /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 404 len: 111 microversion: 2.1 time: 0.031273 Sep 13 01:25:08.885656 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 436/863] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:25:08 2022] DELETE /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:08.890030 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3dc74c5d-b325-4bec-8dd3-4d2d66918112 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:08.890647 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3dc74c5d-b325-4bec-8dd3-4d2d66918112 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] [instance: 85de1ecb-9d12-49d4-b0cd-4631e36357d3] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:08.896686 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5d-b325-4bec-8dd3-4d2d66918112 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:08.897220 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5d-b325-4bec-8dd3-4d2d66918112 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:08.897771 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5d-b325-4bec-8dd3-4d2d66918112 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:08.898549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5d-b325-4bec-8dd3-4d2d66918112 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:08.899039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5d-b325-4bec-8dd3-4d2d66918112 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:08.899468 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3dc74c5d-b325-4bec-8dd3-4d2d66918112 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:08.912675 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-3dc74c5d-b325-4bec-8dd3-4d2d66918112 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] HTTP exception thrown: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3dc74c5d-b325-4bec-8dd3-4d2d66918112 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Request method failure captured: Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 HTTP/1.1 Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9pvh40nDQ7g0KDNIPvORUr0smXyn_a8EcB09L9t5ZYs6h-by3z3aSE_AXGz83-pX54TofZ_8CuYUqOd_8qmFVtD1HGtEnI5HWK64ftQV48tZn2FZS5hRN0kjchMampfCqgFfxC1_gQRj4ZU7LWcd_C_bolEfAWAV4ntXABiEUjE_44 Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 9056ec686513412a87c292387e25e870 Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:08.914750 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:08.916312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_9056ec686513412a87c292387e25e870"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9056ec686513412a87c292387e25e870"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/9056ec686513412a87c292387e25e870"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/9056ec686513412a87c292387e25e870"}]}] Sep 13 01:25:08.916312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:08.916312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 9056ec686513412a87c292387e25e870 Sep 13 01:25:08.916312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1146747367 Sep 13 01:25:08.916312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-AttachVolumeTestJSON-1146747367-project Sep 13 01:25:08.916312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:08.916312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:08.916312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 349e19300f1e48c3ac44fc34611c7f4a Sep 13 01:25:08.916312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-AttachVolumeTestJSON-1146747367-project Sep 13 01:25:08.916312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:25:08.916312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:25:08.916312 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '85de1ecb-9d12-49d4-b0cd-4631e36357d3'} Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:08.917437 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. Sep 13 01:25:08.918809 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:08.920549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3dc74c5d-b325-4bec-8dd3-4d2d66918112 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] Returning 404 to user: Instance 85de1ecb-9d12-49d4-b0cd-4631e36357d3 could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:08.920549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3dc74c5d-b325-4bec-8dd3-4d2d66918112 tempest-AttachVolumeTestJSON-1146747367 tempest-AttachVolumeTestJSON-1146747367-project] 10.222.0.15 "GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3" status: 404 len: 111 microversion: 2.1 time: 0.029920 Sep 13 01:25:08.920549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 428/864] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:08 2022] GET /compute/v2.1/servers/85de1ecb-9d12-49d4-b0cd-4631e36357d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:13.259265 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1ddfe749-2b64-45df-ae92-bc1a71067c98 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Action: 'create', calling method: .version_select at 0x7fb05e340550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1014006150", "metadata": {"Type": "work"}}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1ddfe749-2b64-45df-ae92-bc1a71067c98 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Request method failure captured: Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 122 Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9v5u2SxRmIptv5g_IL4DdEX0VHbHNg1aGqE4Tgks0JQsxYEHdsmydj9lwSj3isOUxYmK6K_b9_Vk512XDmqw5oyBk0IGZMTsZ6ZNtkmZa47jxBoAtWfyBgxhoIhAtekrJqFha9APR09GtT6O1NYitcmv7dJtdh6bPk9wuqEYK5m_i0 Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 66ec56a460d045a3a3f105b9e72f9e20 Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:25:13.269398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:25:13.270808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ec56a460d045a3a3f105b9e72f9e20"}]}] Sep 13 01:25:13.270808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.270808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 66ec56a460d045a3a3f105b9e72f9e20 Sep 13 01:25:13.270808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.270808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesNegativeTest-1221913318-project Sep 13 01:25:13.270808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:25:13.270808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:25:13.270808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: b1a5d55e95f9421f98df6d99e80f6cd4 Sep 13 01:25:13.270808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesNegativeTest-1221913318-project Sep 13 01:25:13.270808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Sep 13 01:25:13.270808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1014006150", "metadata": {"Type": "work"}}} Sep 13 01:25:13.270808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: Sep 13 01:25:13.270808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1014006150', 'metadata': {'Type': 'work'}}}} Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise error Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi '#$%' Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:13.271698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 01:25:13.273009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 01:25:13.274304 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 13 01:25:13.274304 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.274304 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1ddfe749-2b64-45df-ae92-bc1a71067c98 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:13.274304 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1ddfe749-2b64-45df-ae92-bc1a71067c98 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.143725 Sep 13 01:25:13.274304 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 437/865] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Sep 13 01:25:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 01:25:13.280702 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5a88d49f-6ec7-4eb4-a235-96d4d0af4b3f tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Action: 'create', calling method: .version_select at 0x7fb05e2b0160>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-590429155", "metadata": {"Type": "work"}}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5a88d49f-6ec7-4eb4-a235-96d4d0af4b3f tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Request method failure captured: Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 119 Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9v5u2SxRmIptv5g_IL4DdEX0VHbHNg1aGqE4Tgks0JQsxYEHdsmydj9lwSj3isOUxYmK6K_b9_Vk512XDmqw5oyBk0IGZMTsZ6ZNtkmZa47jxBoAtWfyBgxhoIhAtekrJqFha9APR09GtT6O1NYitcmv7dJtdh6bPk9wuqEYK5m_i0 Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 66ec56a460d045a3a3f105b9e72f9e20 Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:13.285231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:13.286717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ec56a460d045a3a3f105b9e72f9e20"}]}] Sep 13 01:25:13.286717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.286717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 66ec56a460d045a3a3f105b9e72f9e20 Sep 13 01:25:13.286717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.286717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-VolumesNegativeTest-1221913318-project Sep 13 01:25:13.286717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:13.286717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:13.286717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: b1a5d55e95f9421f98df6d99e80f6cd4 Sep 13 01:25:13.286717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-VolumesNegativeTest-1221913318-project Sep 13 01:25:13.286717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Sep 13 01:25:13.286717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-590429155", "metadata": {"Type": "work"}}} Sep 13 01:25:13.286717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: Sep 13 01:25:13.286717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-590429155', 'metadata': {'Type': 'work'}}}} Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise error Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi '0' Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:13.287655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 01:25:13.289601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 01:25:13.292366 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 13 01:25:13.292366 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.292366 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5a88d49f-6ec7-4eb4-a235-96d4d0af4b3f tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:13.292366 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-5a88d49f-6ec7-4eb4-a235-96d4d0af4b3f tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009777 Sep 13 01:25:13.292366 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 429/866] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Sep 13 01:25:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 01:25:13.297781 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e178b921-4a85-4ef0-b718-00ebbdf40f9b tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Action: 'create', calling method: .version_select at 0x7fb05e3e25e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-448999664", "metadata": {"Type": "work"}}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e178b921-4a85-4ef0-b718-00ebbdf40f9b tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Request method failure captured: Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 118 Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9v5u2SxRmIptv5g_IL4DdEX0VHbHNg1aGqE4Tgks0JQsxYEHdsmydj9lwSj3isOUxYmK6K_b9_Vk512XDmqw5oyBk0IGZMTsZ6ZNtkmZa47jxBoAtWfyBgxhoIhAtekrJqFha9APR09GtT6O1NYitcmv7dJtdh6bPk9wuqEYK5m_i0 Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 66ec56a460d045a3a3f105b9e72f9e20 Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:25:13.302364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:25:13.303768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ec56a460d045a3a3f105b9e72f9e20"}]}] Sep 13 01:25:13.303768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.303768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 66ec56a460d045a3a3f105b9e72f9e20 Sep 13 01:25:13.303768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.303768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesNegativeTest-1221913318-project Sep 13 01:25:13.303768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:25:13.303768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:25:13.303768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: b1a5d55e95f9421f98df6d99e80f6cd4 Sep 13 01:25:13.303768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesNegativeTest-1221913318-project Sep 13 01:25:13.303768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Sep 13 01:25:13.303768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-448999664", "metadata": {"Type": "work"}}} Sep 13 01:25:13.303768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: Sep 13 01:25:13.303768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-448999664', 'metadata': {'Type': 'work'}}}} Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise error Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi '' Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:13.305539 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 13 01:25:13.307374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 13 01:25:13.308577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 13 01:25:13.308577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.308577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e178b921-4a85-4ef0-b718-00ebbdf40f9b tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:13.308577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e178b921-4a85-4ef0-b718-00ebbdf40f9b tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009803 Sep 13 01:25:13.308577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 438/867] 10.222.0.15 () {60 vars in 1156 bytes} [Tue Sep 13 01:25:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 13 01:25:13.314973 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1a1715c3-764d-4a95-8b60-cd9027965c91 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Calling method '.version_select at 0x7fb05e31bb80>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:13.344232 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-1a1715c3-764d-4a95-8b60-cd9027965c91 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] HTTP exception thrown: Volume tempest-invalid-347917804 could not be found. Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1a1715c3-764d-4a95-8b60-cd9027965c91 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Request method failure captured: Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-347917804 HTTP/1.1 Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9v5u2SxRmIptv5g_IL4DdEX0VHbHNg1aGqE4Tgks0JQsxYEHdsmydj9lwSj3isOUxYmK6K_b9_Vk512XDmqw5oyBk0IGZMTsZ6ZNtkmZa47jxBoAtWfyBgxhoIhAtekrJqFha9APR09GtT6O1NYitcmv7dJtdh6bPk9wuqEYK5m_i0 Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 66ec56a460d045a3a3f105b9e72f9e20 Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:13.346159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:13.347754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ec56a460d045a3a3f105b9e72f9e20"}]}] Sep 13 01:25:13.347754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.347754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 66ec56a460d045a3a3f105b9e72f9e20 Sep 13 01:25:13.347754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.347754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-VolumesNegativeTest-1221913318-project Sep 13 01:25:13.347754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:13.347754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:13.347754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: b1a5d55e95f9421f98df6d99e80f6cd4 Sep 13 01:25:13.347754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-VolumesNegativeTest-1221913318-project Sep 13 01:25:13.347754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: Sep 13 01:25:13.347754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Volume tempest-invalid-347917804 could not be found. Sep 13 01:25:13.347754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': 'tempest-invalid-347917804'} Sep 13 01:25:13.347754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-347917804 could not be found. (HTTP 404) (Request-ID: req-82b23ad8-2afc-4d97-ac51-0b9bb7429d81) Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.348801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 01:25:13.350161 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-347917804 could not be found. Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:13.352210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-347917804 could not be found. Sep 13 01:25:13.353624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.353624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.353624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.353624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.353624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:13.353624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:13.353624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:13.353624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:13.353624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-347917804 could not be found. Sep 13 01:25:13.353624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.353624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1a1715c3-764d-4a95-8b60-cd9027965c91 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Returning 404 to user: Volume tempest-invalid-347917804 could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:13.353624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1a1715c3-764d-4a95-8b60-cd9027965c91 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-347917804" status: 404 len: 98 microversion: 2.1 time: 0.037185 Sep 13 01:25:13.353624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 430/868] 10.222.0.15 () {58 vars in 1215 bytes} [Tue Sep 13 01:25:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-347917804 => generated 98 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 13 01:25:13.358241 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f574eeb7-82f4-47e1-aa6d-14e4170a5a22 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003910 Sep 13 01:25:13.358949 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 439/869] 10.222.0.15 () {58 vars in 1140 bytes} [Tue Sep 13 01:25:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 01:25:13.367866 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9d3d6013-f789-424f-a12e-20dc7188cf6b tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003649 Sep 13 01:25:13.372117 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 431/870] 10.222.0.15 () {58 vars in 1137 bytes} [Tue Sep 13 01:25:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 13 01:25:13.376951 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2f8e7ef1-4792-4a1c-bd0f-3976ba5f6f7d tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Calling method '.version_select at 0x7fb05e795940>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-2f8e7ef1-4792-4a1c-bd0f-3976ba5f6f7d tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] HTTP exception thrown: Volume d2b48cfb-cba3-470e-8035-152859a4f438 could not be found. Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2f8e7ef1-4792-4a1c-bd0f-3976ba5f6f7d tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Request method failure captured: Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/os-volumes/d2b48cfb-cba3-470e-8035-152859a4f438 HTTP/1.1 Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9v5u2SxRmIptv5g_IL4DdEX0VHbHNg1aGqE4Tgks0JQsxYEHdsmydj9lwSj3isOUxYmK6K_b9_Vk512XDmqw5oyBk0IGZMTsZ6ZNtkmZa47jxBoAtWfyBgxhoIhAtekrJqFha9APR09GtT6O1NYitcmv7dJtdh6bPk9wuqEYK5m_i0 Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 66ec56a460d045a3a3f105b9e72f9e20 Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:25:13.410898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:25:13.412618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ec56a460d045a3a3f105b9e72f9e20"}]}] Sep 13 01:25:13.412618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.412618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 66ec56a460d045a3a3f105b9e72f9e20 Sep 13 01:25:13.412618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.412618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesNegativeTest-1221913318-project Sep 13 01:25:13.412618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:25:13.412618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:25:13.412618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: b1a5d55e95f9421f98df6d99e80f6cd4 Sep 13 01:25:13.412618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesNegativeTest-1221913318-project Sep 13 01:25:13.412618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: Sep 13 01:25:13.412618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Volume d2b48cfb-cba3-470e-8035-152859a4f438 could not be found. Sep 13 01:25:13.412618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': 'd2b48cfb-cba3-470e-8035-152859a4f438'} Sep 13 01:25:13.412618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2b48cfb-cba3-470e-8035-152859a4f438 could not be found. (HTTP 404) (Request-ID: req-c35b57e3-0ec0-4230-99d2-67c4dbddc173) Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.413602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 01:25:13.415868 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2b48cfb-cba3-470e-8035-152859a4f438 could not be found. Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 01:25:13.416993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2b48cfb-cba3-470e-8035-152859a4f438 could not be found. Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2b48cfb-cba3-470e-8035-152859a4f438 could not be found. Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2f8e7ef1-4792-4a1c-bd0f-3976ba5f6f7d tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Returning 404 to user: Volume d2b48cfb-cba3-470e-8035-152859a4f438 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2f8e7ef1-4792-4a1c-bd0f-3976ba5f6f7d tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/d2b48cfb-cba3-470e-8035-152859a4f438" status: 404 len: 109 microversion: 2.1 time: 0.040201 Sep 13 01:25:13.418085 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 440/871] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 01:25:13 2022] DELETE /compute/v2.1/os-volumes/d2b48cfb-cba3-470e-8035-152859a4f438 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:13.423391 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-6cee5e3b-b3d3-4ae8-a85a-a99b40bc8fb5 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Calling method '.version_select at 0x7fb05e2b0310>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:13.451096 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-6cee5e3b-b3d3-4ae8-a85a-a99b40bc8fb5 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] HTTP exception thrown: Volume e213dd3d-aca6-4a17-aab0-2766f0be727a could not be found. Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-6cee5e3b-b3d3-4ae8-a85a-a99b40bc8fb5 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Request method failure captured: Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/os-volumes/e213dd3d-aca6-4a17-aab0-2766f0be727a HTTP/1.1 Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9v5u2SxRmIptv5g_IL4DdEX0VHbHNg1aGqE4Tgks0JQsxYEHdsmydj9lwSj3isOUxYmK6K_b9_Vk512XDmqw5oyBk0IGZMTsZ6ZNtkmZa47jxBoAtWfyBgxhoIhAtekrJqFha9APR09GtT6O1NYitcmv7dJtdh6bPk9wuqEYK5m_i0 Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 66ec56a460d045a3a3f105b9e72f9e20 Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:13.453039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:13.454561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66ec56a460d045a3a3f105b9e72f9e20"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66ec56a460d045a3a3f105b9e72f9e20"}]}] Sep 13 01:25:13.454561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.454561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 66ec56a460d045a3a3f105b9e72f9e20 Sep 13 01:25:13.454561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-VolumesNegativeTest-1221913318 Sep 13 01:25:13.454561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-VolumesNegativeTest-1221913318-project Sep 13 01:25:13.454561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:13.454561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:13.454561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: b1a5d55e95f9421f98df6d99e80f6cd4 Sep 13 01:25:13.454561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-VolumesNegativeTest-1221913318-project Sep 13 01:25:13.454561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: Sep 13 01:25:13.454561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Volume e213dd3d-aca6-4a17-aab0-2766f0be727a could not be found. Sep 13 01:25:13.454561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': 'e213dd3d-aca6-4a17-aab0-2766f0be727a'} Sep 13 01:25:13.454561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e213dd3d-aca6-4a17-aab0-2766f0be727a could not be found. (HTTP 404) (Request-ID: req-bd782442-7260-4fa2-8abc-37ddbae4108b) Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.455722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 01:25:13.457042 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e213dd3d-aca6-4a17-aab0-2766f0be727a could not be found. Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 01:25:13.458349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e213dd3d-aca6-4a17-aab0-2766f0be727a could not be found. Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e213dd3d-aca6-4a17-aab0-2766f0be727a could not be found. Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-6cee5e3b-b3d3-4ae8-a85a-a99b40bc8fb5 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] Returning 404 to user: Volume e213dd3d-aca6-4a17-aab0-2766f0be727a could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-6cee5e3b-b3d3-4ae8-a85a-a99b40bc8fb5 tempest-VolumesNegativeTest-1221913318 tempest-VolumesNegativeTest-1221913318-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/e213dd3d-aca6-4a17-aab0-2766f0be727a" status: 404 len: 109 microversion: 2.1 time: 0.034772 Sep 13 01:25:13.459912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 432/872] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:25:13 2022] GET /compute/v2.1/os-volumes/e213dd3d-aca6-4a17-aab0-2766f0be727a => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 01:25:16.704879 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-b8d6c319-1814-4b3e-96be-c2945cd22e96 req-a1747045-6292-43b0-b126-be451d4ce721 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf5279a7-4859-458b-958c-85fd71cb4d72", "tag": "c4858902-df62-4017-b106-503915275745"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:16.706645 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-276c5421-d603-46ef-8ec8-dc840e90e383 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:16.708016 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-276c5421-d603-46ef-8ec8-dc840e90e383 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:16.732432 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-276c5421-d603-46ef-8ec8-dc840e90e383 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:16.734797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-b8d6c319-1814-4b3e-96be-c2945cd22e96 req-a1747045-6292-43b0-b126-be451d4ce721 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:16.755295 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-276c5421-d603-46ef-8ec8-dc840e90e383 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:16.755864 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-276c5421-d603-46ef-8ec8-dc840e90e383 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:16.756641 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-276c5421-d603-46ef-8ec8-dc840e90e383 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:16.757125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-276c5421-d603-46ef-8ec8-dc840e90e383 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:16.758138 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-276c5421-d603-46ef-8ec8-dc840e90e383 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:16.761338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-b8d6c319-1814-4b3e-96be-c2945cd22e96 req-a1747045-6292-43b0-b126-be451d4ce721 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:16.761839 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-b8d6c319-1814-4b3e-96be-c2945cd22e96 req-a1747045-6292-43b0-b126-be451d4ce721 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:16.791861 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-b8d6c319-1814-4b3e-96be-c2945cd22e96 req-a1747045-6292-43b0-b126-be451d4ce721 service nova] Creating event network-changed:c4858902-df62-4017-b106-503915275745 for instance cf5279a7-4859-458b-958c-85fd71cb4d72 on hv-cinder-85694 Sep 13 01:25:16.799980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-b8d6c319-1814-4b3e-96be-c2945cd22e96 req-a1747045-6292-43b0-b126-be451d4ce721 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103790 Sep 13 01:25:16.801074 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 433/873] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:25:16.815137 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:16.832470 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-276c5421-d603-46ef-8ec8-dc840e90e383 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:25:16.984218 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-276c5421-d603-46ef-8ec8-dc840e90e383 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "DELETE /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 204 len: 0 microversion: 2.1 time: 0.294304 Sep 13 01:25:16.985200 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 441/874] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:25:16 2022] DELETE /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:25:16.996862 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5e996ebf-fb30-4473-a43d-e4306634632a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:16.998110 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-5e996ebf-fb30-4473-a43d-e4306634632a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:17.005267 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5e996ebf-fb30-4473-a43d-e4306634632a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:17.005960 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5e996ebf-fb30-4473-a43d-e4306634632a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:17.006592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5e996ebf-fb30-4473-a43d-e4306634632a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:17.007550 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5e996ebf-fb30-4473-a43d-e4306634632a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:17.008164 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5e996ebf-fb30-4473-a43d-e4306634632a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:17.009047 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5e996ebf-fb30-4473-a43d-e4306634632a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:17.514533 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5e996ebf-fb30-4473-a43d-e4306634632a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:17.524668 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-5e996ebf-fb30-4473-a43d-e4306634632a tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.534889 Sep 13 01:25:17.525243 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 434/875] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:16 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:18.555051 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8bc05fd6-cb61-4402-b023-2a504dbd132c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:18.556877 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8bc05fd6-cb61-4402-b023-2a504dbd132c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:18.569495 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8bc05fd6-cb61-4402-b023-2a504dbd132c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:18.571359 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8bc05fd6-cb61-4402-b023-2a504dbd132c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:18.572198 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8bc05fd6-cb61-4402-b023-2a504dbd132c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:18.573614 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8bc05fd6-cb61-4402-b023-2a504dbd132c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:18.574426 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8bc05fd6-cb61-4402-b023-2a504dbd132c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:18.574887 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8bc05fd6-cb61-4402-b023-2a504dbd132c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:18.782251 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8bc05fd6-cb61-4402-b023-2a504dbd132c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:18.793258 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8bc05fd6-cb61-4402-b023-2a504dbd132c tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1567 microversion: 2.1 time: 0.243013 Sep 13 01:25:18.812853 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 442/876] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:18 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:19.420715 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-9ab2d58a-a195-4a3a-b515-dd665bd8b13c req-61f46223-db46-40da-8717-6e5d471089ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf5279a7-4859-458b-958c-85fd71cb4d72", "name": "network-vif-deleted", "tag": "c4858902-df62-4017-b106-503915275745"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:19.435295 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-9ab2d58a-a195-4a3a-b515-dd665bd8b13c req-61f46223-db46-40da-8717-6e5d471089ef service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:19.435785 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-9ab2d58a-a195-4a3a-b515-dd665bd8b13c req-61f46223-db46-40da-8717-6e5d471089ef service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:19.436225 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-9ab2d58a-a195-4a3a-b515-dd665bd8b13c req-61f46223-db46-40da-8717-6e5d471089ef service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:19.456737 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-9ab2d58a-a195-4a3a-b515-dd665bd8b13c req-61f46223-db46-40da-8717-6e5d471089ef service nova] Creating event network-vif-deleted:c4858902-df62-4017-b106-503915275745 for instance cf5279a7-4859-458b-958c-85fd71cb4d72 on hv-cinder-85694 Sep 13 01:25:19.463434 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-9ab2d58a-a195-4a3a-b515-dd665bd8b13c req-61f46223-db46-40da-8717-6e5d471089ef service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046891 Sep 13 01:25:19.464528 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 435/877] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:19.824125 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3d26b012-1957-4481-87d8-291b02289f17 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:19.825020 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3d26b012-1957-4481-87d8-291b02289f17 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:19.833374 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d26b012-1957-4481-87d8-291b02289f17 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:19.834023 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d26b012-1957-4481-87d8-291b02289f17 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:19.834603 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d26b012-1957-4481-87d8-291b02289f17 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:19.836219 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d26b012-1957-4481-87d8-291b02289f17 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:19.836786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d26b012-1957-4481-87d8-291b02289f17 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:19.837311 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3d26b012-1957-4481-87d8-291b02289f17 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:19.953604 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-3d26b012-1957-4481-87d8-291b02289f17 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '85178dc2280c4a54970fc207d1746608', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de31bd722d4f419d9269b519af7f793a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:19.974720 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3d26b012-1957-4481-87d8-291b02289f17 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 200 len: 1219 microversion: 2.1 time: 0.155271 Sep 13 01:25:19.990713 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 443/878] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:19 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 1219 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:20.998966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-deeb5cbc-d889-426e-93fe-ff34e483ea04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:20.999590 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-deeb5cbc-d889-426e-93fe-ff34e483ea04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] [instance: cf5279a7-4859-458b-958c-85fd71cb4d72] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:21.005722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-deeb5cbc-d889-426e-93fe-ff34e483ea04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:21.006213 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-deeb5cbc-d889-426e-93fe-ff34e483ea04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:21.006876 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-deeb5cbc-d889-426e-93fe-ff34e483ea04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:21.007883 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-deeb5cbc-d889-426e-93fe-ff34e483ea04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:21.008529 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-deeb5cbc-d889-426e-93fe-ff34e483ea04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:21.009110 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-deeb5cbc-d889-426e-93fe-ff34e483ea04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:21.025039 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-deeb5cbc-d889-426e-93fe-ff34e483ea04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] HTTP exception thrown: Instance cf5279a7-4859-458b-958c-85fd71cb4d72 could not be found. Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-deeb5cbc-d889-426e-93fe-ff34e483ea04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Request method failure captured: Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 HTTP/1.1 Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9q1LC9R_DE1Dpj5grFHsFw67hMIfZrv3PDE1lF2sIjx4wpGrvZ3_vQ_TueOtp-yh4J4uBbPUvQgkyfLegXIDSiiJIArJBR0Xi3xKxeXzd6fpag7ZZBA7D5QK5M6F90bmS1-fuQIT4HiGPHNd576Mfx1dFIM9xFbfFOSuzj26-MSDZY Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: de31bd722d4f419d9269b519af7f793a Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-TestShelveInstance-2027084053 Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:21.026682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:21.028230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_de31bd722d4f419d9269b519af7f793a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de31bd722d4f419d9269b519af7f793a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/de31bd722d4f419d9269b519af7f793a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/de31bd722d4f419d9269b519af7f793a"}]}] Sep 13 01:25:21.028230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-TestShelveInstance-2027084053 Sep 13 01:25:21.028230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: de31bd722d4f419d9269b519af7f793a Sep 13 01:25:21.028230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-TestShelveInstance-2027084053 Sep 13 01:25:21.028230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-TestShelveInstance-2027084053-project Sep 13 01:25:21.028230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:21.028230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:21.028230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 85178dc2280c4a54970fc207d1746608 Sep 13 01:25:21.028230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-TestShelveInstance-2027084053-project Sep 13 01:25:21.028230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:25:21.028230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance cf5279a7-4859-458b-958c-85fd71cb4d72 could not be found. Sep 13 01:25:21.028230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': 'cf5279a7-4859-458b-958c-85fd71cb4d72'} Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cf5279a7-4859-458b-958c-85fd71cb4d72 could not be found. Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:21.028978 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cf5279a7-4859-458b-958c-85fd71cb4d72 could not be found. Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cf5279a7-4859-458b-958c-85fd71cb4d72 could not be found. Sep 13 01:25:21.030270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:21.032652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-deeb5cbc-d889-426e-93fe-ff34e483ea04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Returning 404 to user: Instance cf5279a7-4859-458b-958c-85fd71cb4d72 could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:21.032652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-deeb5cbc-d889-426e-93fe-ff34e483ea04 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72" status: 404 len: 111 microversion: 2.1 time: 0.034062 Sep 13 01:25:21.032652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 436/879] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:20 2022] GET /compute/v2.1/servers/cf5279a7-4859-458b-958c-85fd71cb4d72 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 01:25:21.204828 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1c7fe7ea-cc3e-43ef-a6f4-dfe034cc4514 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] Calling method '.version_select at 0x7fb05e38c8b0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:21.240922 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1c7fe7ea-cc3e-43ef-a6f4-dfe034cc4514 tempest-TestShelveInstance-2027084053 tempest-TestShelveInstance-2027084053-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-758260512" status: 202 len: 0 microversion: 2.1 time: 0.040431 Sep 13 01:25:21.244908 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 444/880] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 01:25:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-758260512 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:25:29.001886 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a5260a1b-2794-41b0-8b73-3d93257fbe5a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:29.004677 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a5260a1b-2794-41b0-8b73-3d93257fbe5a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:29.026541 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:29.035169 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5260a1b-2794-41b0-8b73-3d93257fbe5a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:29.035847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5260a1b-2794-41b0-8b73-3d93257fbe5a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:29.036549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5260a1b-2794-41b0-8b73-3d93257fbe5a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:29.037415 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5260a1b-2794-41b0-8b73-3d93257fbe5a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:29.038554 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5260a1b-2794-41b0-8b73-3d93257fbe5a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:29.039186 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a5260a1b-2794-41b0-8b73-3d93257fbe5a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:29.095578 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a5260a1b-2794-41b0-8b73-3d93257fbe5a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.097819 Sep 13 01:25:29.096751 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 437/881] 10.222.0.15 () {60 vars in 1343 bytes} [Tue Sep 13 01:25:28 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d/os-volume_attachments => generated 25 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:29.204091 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f31f2f1a-c192-4b1e-bcc9-d2f5af63d3a5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:29.204625 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f31f2f1a-c192-4b1e-bcc9-d2f5af63d3a5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:29.216794 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:29.218269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f31f2f1a-c192-4b1e-bcc9-d2f5af63d3a5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:29.219040 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f31f2f1a-c192-4b1e-bcc9-d2f5af63d3a5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:29.219665 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f31f2f1a-c192-4b1e-bcc9-d2f5af63d3a5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:29.220595 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f31f2f1a-c192-4b1e-bcc9-d2f5af63d3a5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:29.221231 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f31f2f1a-c192-4b1e-bcc9-d2f5af63d3a5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:29.221820 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f31f2f1a-c192-4b1e-bcc9-d2f5af63d3a5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:29.266593 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f31f2f1a-c192-4b1e-bcc9-d2f5af63d3a5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:25:29.420586 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f31f2f1a-c192-4b1e-bcc9-d2f5af63d3a5 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "DELETE /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 204 len: 0 microversion: 2.20 time: 0.220333 Sep 13 01:25:29.421653 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 445/882] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Sep 13 01:25:29 2022] DELETE /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 01:25:29.430792 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b17dd058-02fa-400d-890d-8b6bb6a982be tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:29.431539 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b17dd058-02fa-400d-890d-8b6bb6a982be tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:29.438439 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b17dd058-02fa-400d-890d-8b6bb6a982be tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:29.439078 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b17dd058-02fa-400d-890d-8b6bb6a982be tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:29.439589 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b17dd058-02fa-400d-890d-8b6bb6a982be tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:29.440537 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b17dd058-02fa-400d-890d-8b6bb6a982be tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:29.441872 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b17dd058-02fa-400d-890d-8b6bb6a982be tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:29.442541 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b17dd058-02fa-400d-890d-8b6bb6a982be tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:29.622087 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b17dd058-02fa-400d-890d-8b6bb6a982be tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:29.639508 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b17dd058-02fa-400d-890d-8b6bb6a982be tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:29.641004 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b17dd058-02fa-400d-890d-8b6bb6a982be tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:29.642191 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b17dd058-02fa-400d-890d-8b6bb6a982be tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.216303 Sep 13 01:25:29.642751 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 438/883] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:25:29 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:25:30.568076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-38b2373c-e7ca-4ddb-8b92-84703684bec8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:30.568668 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-38b2373c-e7ca-4ddb-8b92-84703684bec8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:30.586799 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38b2373c-e7ca-4ddb-8b92-84703684bec8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:30.587329 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38b2373c-e7ca-4ddb-8b92-84703684bec8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:30.587765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38b2373c-e7ca-4ddb-8b92-84703684bec8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:30.588696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38b2373c-e7ca-4ddb-8b92-84703684bec8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:30.589349 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38b2373c-e7ca-4ddb-8b92-84703684bec8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:30.589930 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-38b2373c-e7ca-4ddb-8b92-84703684bec8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:30.614668 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-38b2373c-e7ca-4ddb-8b92-84703684bec8 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001/ips" status: 200 len: 149 microversion: 2.1 time: 0.373683 Sep 13 01:25:30.615510 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 446/884] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 01:25:30 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001/ips => generated 149 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:30.681224 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c2c74136-ce82-42d2-b990-97e5516ff144 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:30.683532 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c2c74136-ce82-42d2-b990-97e5516ff144 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:30.695638 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2c74136-ce82-42d2-b990-97e5516ff144 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:30.696547 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2c74136-ce82-42d2-b990-97e5516ff144 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:30.697252 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2c74136-ce82-42d2-b990-97e5516ff144 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:30.701654 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2c74136-ce82-42d2-b990-97e5516ff144 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:30.706566 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2c74136-ce82-42d2-b990-97e5516ff144 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:30.707217 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2c74136-ce82-42d2-b990-97e5516ff144 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:30.717880 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:31.000644 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c2c74136-ce82-42d2-b990-97e5516ff144 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:31.011677 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c2c74136-ce82-42d2-b990-97e5516ff144 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:31.018304 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c2c74136-ce82-42d2-b990-97e5516ff144 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:31.026756 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c2c74136-ce82-42d2-b990-97e5516ff144 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1722 microversion: 2.20 time: 0.358573 Sep 13 01:25:31.027357 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 439/885] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:25:30 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1722 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:25:32.053549 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-28f06859-9187-44dd-b54d-451aec431467 req-f263bf01-7d5d-47b1-9fec-6891a0b9ddf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29d56cdc-0d80-4681-9384-b1df6e5a403d", "name": "network-vif-deleted", "tag": "7eba6092-8d78-465f-a5ad-642414710fd4"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:32.055240 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-09f471ee-9b66-4c29-b067-3c4d26694b14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:32.056030 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-09f471ee-9b66-4c29-b067-3c4d26694b14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:32.065713 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-09f471ee-9b66-4c29-b067-3c4d26694b14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:32.066309 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-09f471ee-9b66-4c29-b067-3c4d26694b14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:32.080796 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-09f471ee-9b66-4c29-b067-3c4d26694b14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:32.080796 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-09f471ee-9b66-4c29-b067-3c4d26694b14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:32.082219 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-28f06859-9187-44dd-b54d-451aec431467 req-f263bf01-7d5d-47b1-9fec-6891a0b9ddf8 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:32.083385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-09f471ee-9b66-4c29-b067-3c4d26694b14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:32.083930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-09f471ee-9b66-4c29-b067-3c4d26694b14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:32.087008 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-28f06859-9187-44dd-b54d-451aec431467 req-f263bf01-7d5d-47b1-9fec-6891a0b9ddf8 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:32.087258 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-28f06859-9187-44dd-b54d-451aec431467 req-f263bf01-7d5d-47b1-9fec-6891a0b9ddf8 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:32.107080 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-28f06859-9187-44dd-b54d-451aec431467 req-f263bf01-7d5d-47b1-9fec-6891a0b9ddf8 service nova] Creating event network-vif-deleted:7eba6092-8d78-465f-a5ad-642414710fd4 for instance 29d56cdc-0d80-4681-9384-b1df6e5a403d on hv-cinder-85694 Sep 13 01:25:32.118669 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-28f06859-9187-44dd-b54d-451aec431467 req-f263bf01-7d5d-47b1-9fec-6891a0b9ddf8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068199 Sep 13 01:25:32.119895 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 447/886] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:32.204154 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-09f471ee-9b66-4c29-b067-3c4d26694b14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:32.213059 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-09f471ee-9b66-4c29-b067-3c4d26694b14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:32.215764 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-09f471ee-9b66-4c29-b067-3c4d26694b14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e2846ad486314958bb74af71b647c470', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7a9e1eee32f04f3cabd8219d36d2c6a7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:32.217636 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-09f471ee-9b66-4c29-b067-3c4d26694b14 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 200 len: 1366 microversion: 2.20 time: 0.166337 Sep 13 01:25:32.218823 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 440/887] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:25:32 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 13 01:25:32.223266 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d0ffb3f9-bbe5-46b6-8e52-b2eadd694b89 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5000c199-c0d4-430e-91db-36ebcbfafd81"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:32.226492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d0ffb3f9-bbe5-46b6-8e52-b2eadd694b89 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:32.235410 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0ffb3f9-bbe5-46b6-8e52-b2eadd694b89 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:32.236378 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0ffb3f9-bbe5-46b6-8e52-b2eadd694b89 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:32.237119 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0ffb3f9-bbe5-46b6-8e52-b2eadd694b89 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:32.254097 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0ffb3f9-bbe5-46b6-8e52-b2eadd694b89 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:32.256378 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0ffb3f9-bbe5-46b6-8e52-b2eadd694b89 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:32.258218 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0ffb3f9-bbe5-46b6-8e52-b2eadd694b89 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:32.614203 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d0ffb3f9-bbe5-46b6-8e52-b2eadd694b89 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "POST /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.395902 Sep 13 01:25:32.615104 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 448/888] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:25:32 2022] POST /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:33.248125 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ef9bdca7-19ff-4754-9092-10d67004358a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:33.249502 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ef9bdca7-19ff-4754-9092-10d67004358a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:33.259655 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ef9bdca7-19ff-4754-9092-10d67004358a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:33.260147 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ef9bdca7-19ff-4754-9092-10d67004358a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:33.260591 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ef9bdca7-19ff-4754-9092-10d67004358a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:33.261299 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ef9bdca7-19ff-4754-9092-10d67004358a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:33.261753 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ef9bdca7-19ff-4754-9092-10d67004358a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:33.262181 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ef9bdca7-19ff-4754-9092-10d67004358a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:33.277358 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-ef9bdca7-19ff-4754-9092-10d67004358a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] HTTP exception thrown: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ef9bdca7-19ff-4754-9092-10d67004358a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Request method failure captured: Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d HTTP/1.1 Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9p6SlnnnBAuteeFon40mAkzRXkGPGxE4_AbViw0uwd8Kd3KbI-p6tPvUXILUweIcaGvQUFo-C6MkdTwq-kJBCo4Ab_fddWy1yRyQTawCrGLEmeM26TIGiHItGwl1WErDHu1XuCR8cG1314UHt9-ejdNNXDaSBIPSzvv1JYmNPTd1dU Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 7a9e1eee32f04f3cabd8219d36d2c6a7 Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:33.279052 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:33.280549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}] Sep 13 01:25:33.280549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:33.280549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 7a9e1eee32f04f3cabd8219d36d2c6a7 Sep 13 01:25:33.280549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:33.280549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-AttachVolumeShelveTestJSON-587556596-project Sep 13 01:25:33.280549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:33.280549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:33.280549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: e2846ad486314958bb74af71b647c470 Sep 13 01:25:33.280549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-AttachVolumeShelveTestJSON-587556596-project Sep 13 01:25:33.280549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:25:33.280549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:33.280549 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '29d56cdc-0d80-4681-9384-b1df6e5a403d'} Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:33.281515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:33.282741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:33.283909 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ef9bdca7-19ff-4754-9092-10d67004358a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Returning 404 to user: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:33.284860 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ef9bdca7-19ff-4754-9092-10d67004358a tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 404 len: 111 microversion: 2.20 time: 0.040480 Sep 13 01:25:33.285755 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 441/889] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:25:33 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 01:25:33.295280 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7d3a3558-5813-4a42-89fa-6e315bdf2e4b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '.version_select at 0x7fb061cd0550>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:33.316816 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7d3a3558-5813-4a42-89fa-6e315bdf2e4b tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-695639002" status: 204 len: 0 microversion: 2.20 time: 0.025849 Sep 13 01:25:33.317679 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 449/890] 10.222.0.15 () {60 vars in 1259 bytes} [Tue Sep 13 01:25:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-695639002 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 13 01:25:35.197608 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-484842e6-459f-4cd1-9a15-c7b58df7fe23 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:35.198425 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-484842e6-459f-4cd1-9a15-c7b58df7fe23 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:35.206444 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-484842e6-459f-4cd1-9a15-c7b58df7fe23 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:35.207100 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-484842e6-459f-4cd1-9a15-c7b58df7fe23 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:35.207567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-484842e6-459f-4cd1-9a15-c7b58df7fe23 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:35.208485 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-484842e6-459f-4cd1-9a15-c7b58df7fe23 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:35.209128 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-484842e6-459f-4cd1-9a15-c7b58df7fe23 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:35.210198 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-484842e6-459f-4cd1-9a15-c7b58df7fe23 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:35.224659 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-484842e6-459f-4cd1-9a15-c7b58df7fe23 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] HTTP exception thrown: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-484842e6-459f-4cd1-9a15-c7b58df7fe23 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Request method failure captured: Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: DELETE /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d HTTP/1.1 Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9p6SlnnnBAuteeFon40mAkzRXkGPGxE4_AbViw0uwd8Kd3KbI-p6tPvUXILUweIcaGvQUFo-C6MkdTwq-kJBCo4Ab_fddWy1yRyQTawCrGLEmeM26TIGiHItGwl1WErDHu1XuCR8cG1314UHt9-ejdNNXDaSBIPSzvv1JYmNPTd1dU Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 7a9e1eee32f04f3cabd8219d36d2c6a7 Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:35.227166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:35.228847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}] Sep 13 01:25:35.228847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:35.228847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 7a9e1eee32f04f3cabd8219d36d2c6a7 Sep 13 01:25:35.228847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:35.228847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-AttachVolumeShelveTestJSON-587556596-project Sep 13 01:25:35.228847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:35.228847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:35.228847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: e2846ad486314958bb74af71b647c470 Sep 13 01:25:35.228847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-AttachVolumeShelveTestJSON-587556596-project Sep 13 01:25:35.228847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:25:35.228847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:35.228847 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '29d56cdc-0d80-4681-9384-b1df6e5a403d'} Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:35.229711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:35.231228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:35.232794 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-484842e6-459f-4cd1-9a15-c7b58df7fe23 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Returning 404 to user: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:35.232794 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-484842e6-459f-4cd1-9a15-c7b58df7fe23 tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "DELETE /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 404 len: 111 microversion: 2.20 time: 0.035143 Sep 13 01:25:35.232794 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 442/891] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Sep 13 01:25:35 2022] DELETE /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 01:25:35.237073 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f5a37400-b79e-4d60-a85c-ef6892a553ef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:35.237800 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f5a37400-b79e-4d60-a85c-ef6892a553ef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 29d56cdc-0d80-4681-9384-b1df6e5a403d] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:35.244931 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5a37400-b79e-4d60-a85c-ef6892a553ef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:35.245424 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5a37400-b79e-4d60-a85c-ef6892a553ef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:35.245861 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5a37400-b79e-4d60-a85c-ef6892a553ef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:35.246559 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5a37400-b79e-4d60-a85c-ef6892a553ef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:35.247238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5a37400-b79e-4d60-a85c-ef6892a553ef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:35.247827 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f5a37400-b79e-4d60-a85c-ef6892a553ef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:35.268084 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-f5a37400-b79e-4d60-a85c-ef6892a553ef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] HTTP exception thrown: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f5a37400-b79e-4d60-a85c-ef6892a553ef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Request method failure captured: Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d HTTP/1.1 Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9p6SlnnnBAuteeFon40mAkzRXkGPGxE4_AbViw0uwd8Kd3KbI-p6tPvUXILUweIcaGvQUFo-C6MkdTwq-kJBCo4Ab_fddWy1yRyQTawCrGLEmeM26TIGiHItGwl1WErDHu1XuCR8cG1314UHt9-ejdNNXDaSBIPSzvv1JYmNPTd1dU Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 7a9e1eee32f04f3cabd8219d36d2c6a7 Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:25:35.269757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:25:35.271209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}] Sep 13 01:25:35.271209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:35.271209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 7a9e1eee32f04f3cabd8219d36d2c6a7 Sep 13 01:25:35.271209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:35.271209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeShelveTestJSON-587556596-project Sep 13 01:25:35.271209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:25:35.271209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:25:35.271209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: e2846ad486314958bb74af71b647c470 Sep 13 01:25:35.271209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeShelveTestJSON-587556596-project Sep 13 01:25:35.271209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:25:35.271209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:35.271209 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '29d56cdc-0d80-4681-9384-b1df6e5a403d'} Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:35.272639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. Sep 13 01:25:35.274215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:35.275634 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f5a37400-b79e-4d60-a85c-ef6892a553ef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Returning 404 to user: Instance 29d56cdc-0d80-4681-9384-b1df6e5a403d could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:35.275634 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f5a37400-b79e-4d60-a85c-ef6892a553ef tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d" status: 404 len: 111 microversion: 2.20 time: 0.037929 Sep 13 01:25:35.275634 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 450/892] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:25:35 2022] GET /compute/v2.1/servers/29d56cdc-0d80-4681-9384-b1df6e5a403d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 01:25:36.444088 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d86d4cb9-ee1a-471f-8e27-419edfcef5bf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:36.444629 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d86d4cb9-ee1a-471f-8e27-419edfcef5bf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:36.450794 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d86d4cb9-ee1a-471f-8e27-419edfcef5bf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:36.451506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d86d4cb9-ee1a-471f-8e27-419edfcef5bf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:36.451984 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d86d4cb9-ee1a-471f-8e27-419edfcef5bf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:36.452636 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d86d4cb9-ee1a-471f-8e27-419edfcef5bf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:36.453088 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d86d4cb9-ee1a-471f-8e27-419edfcef5bf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:36.453506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d86d4cb9-ee1a-471f-8e27-419edfcef5bf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:36.466705 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-d86d4cb9-ee1a-471f-8e27-419edfcef5bf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] HTTP exception thrown: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d86d4cb9-ee1a-471f-8e27-419edfcef5bf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Request method failure captured: Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: DELETE /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac HTTP/1.1 Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9p6SlnnnBAuteeFon40mAkzRXkGPGxE4_AbViw0uwd8Kd3KbI-p6tPvUXILUweIcaGvQUFo-C6MkdTwq-kJBCo4Ab_fddWy1yRyQTawCrGLEmeM26TIGiHItGwl1WErDHu1XuCR8cG1314UHt9-ejdNNXDaSBIPSzvv1JYmNPTd1dU Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 7a9e1eee32f04f3cabd8219d36d2c6a7 Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:36.468273 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:36.470011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}] Sep 13 01:25:36.470011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:36.470011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 7a9e1eee32f04f3cabd8219d36d2c6a7 Sep 13 01:25:36.470011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:36.470011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-AttachVolumeShelveTestJSON-587556596-project Sep 13 01:25:36.470011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:36.470011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:36.470011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: e2846ad486314958bb74af71b647c470 Sep 13 01:25:36.470011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-AttachVolumeShelveTestJSON-587556596-project Sep 13 01:25:36.470011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:25:36.470011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:25:36.470011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '1677b90a-17f0-496f-8fce-ac573509c1ac'} Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:36.470902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:25:36.472493 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:36.473947 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d86d4cb9-ee1a-471f-8e27-419edfcef5bf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Returning 404 to user: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:36.473947 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d86d4cb9-ee1a-471f-8e27-419edfcef5bf tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "DELETE /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 404 len: 111 microversion: 2.20 time: 0.029423 Sep 13 01:25:36.473947 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 443/893] 10.222.0.15 () {60 vars in 1280 bytes} [Tue Sep 13 01:25:36 2022] DELETE /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 01:25:36.478546 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-37bf2aca-6f64-46ee-8ede-ae65f01f549c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:36.479180 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-37bf2aca-6f64-46ee-8ede-ae65f01f549c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] [instance: 1677b90a-17f0-496f-8fce-ac573509c1ac] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:36.485586 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37bf2aca-6f64-46ee-8ede-ae65f01f549c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:36.486066 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37bf2aca-6f64-46ee-8ede-ae65f01f549c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:36.486496 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37bf2aca-6f64-46ee-8ede-ae65f01f549c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:36.487221 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37bf2aca-6f64-46ee-8ede-ae65f01f549c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:36.487667 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37bf2aca-6f64-46ee-8ede-ae65f01f549c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:36.488087 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-37bf2aca-6f64-46ee-8ede-ae65f01f549c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:36.502268 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-37bf2aca-6f64-46ee-8ede-ae65f01f549c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] HTTP exception thrown: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-37bf2aca-6f64-46ee-8ede-ae65f01f549c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Request method failure captured: Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac HTTP/1.1 Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9p6SlnnnBAuteeFon40mAkzRXkGPGxE4_AbViw0uwd8Kd3KbI-p6tPvUXILUweIcaGvQUFo-C6MkdTwq-kJBCo4Ab_fddWy1yRyQTawCrGLEmeM26TIGiHItGwl1WErDHu1XuCR8cG1314UHt9-ejdNNXDaSBIPSzvv1JYmNPTd1dU Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Openstack-Nova-Api-Version: 2.20 Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 7a9e1eee32f04f3cabd8219d36d2c6a7 Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:25:36.503836 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:25:36.505466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7a9e1eee32f04f3cabd8219d36d2c6a7"}]}] Sep 13 01:25:36.505466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:36.505466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 7a9e1eee32f04f3cabd8219d36d2c6a7 Sep 13 01:25:36.505466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-587556596 Sep 13 01:25:36.505466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeShelveTestJSON-587556596-project Sep 13 01:25:36.505466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:25:36.505466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:25:36.505466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: e2846ad486314958bb74af71b647c470 Sep 13 01:25:36.505466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeShelveTestJSON-587556596-project Sep 13 01:25:36.505466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:25:36.505466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:25:36.505466 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '1677b90a-17f0-496f-8fce-ac573509c1ac'} Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:36.506313 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. Sep 13 01:25:36.507854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:36.509561 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-37bf2aca-6f64-46ee-8ede-ae65f01f549c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] Returning 404 to user: Instance 1677b90a-17f0-496f-8fce-ac573509c1ac could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:36.509561 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-37bf2aca-6f64-46ee-8ede-ae65f01f549c tempest-AttachVolumeShelveTestJSON-587556596 tempest-AttachVolumeShelveTestJSON-587556596-project] 10.222.0.15 "GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac" status: 404 len: 111 microversion: 2.20 time: 0.031056 Sep 13 01:25:36.509561 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 451/894] 10.222.0.15 () {60 vars in 1277 bytes} [Tue Sep 13 01:25:36 2022] GET /compute/v2.1/servers/1677b90a-17f0-496f-8fce-ac573509c1ac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 13 01:25:39.344244 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d6191c50-912b-4417-908a-c7bf707ab7fe tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:39.345590 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d6191c50-912b-4417-908a-c7bf707ab7fe tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:39.353057 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d6191c50-912b-4417-908a-c7bf707ab7fe tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:39.353757 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d6191c50-912b-4417-908a-c7bf707ab7fe tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:39.354567 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d6191c50-912b-4417-908a-c7bf707ab7fe tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:39.355480 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d6191c50-912b-4417-908a-c7bf707ab7fe tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:39.356093 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d6191c50-912b-4417-908a-c7bf707ab7fe tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:39.357164 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d6191c50-912b-4417-908a-c7bf707ab7fe tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:39.481243 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-d6191c50-912b-4417-908a-c7bf707ab7fe tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lazy-loading 'services' on Instance uuid ecc43951-6c00-456d-bc95-10f6a0771001 {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:25:39.569499 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d6191c50-912b-4417-908a-c7bf707ab7fe tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001/os-volume_attachments/5000c199-c0d4-430e-91db-36ebcbfafd81" status: 202 len: 0 microversion: 2.1 time: 0.235896 Sep 13 01:25:39.570827 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 444/895] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 01:25:39 2022] DELETE /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001/os-volume_attachments/5000c199-c0d4-430e-91db-36ebcbfafd81 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:25:39.579263 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c6a53c97-ab96-48d7-ab17-c1b55f4eabe7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:39.581602 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c6a53c97-ab96-48d7-ab17-c1b55f4eabe7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:39.589419 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6a53c97-ab96-48d7-ab17-c1b55f4eabe7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:39.590073 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6a53c97-ab96-48d7-ab17-c1b55f4eabe7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:39.590650 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6a53c97-ab96-48d7-ab17-c1b55f4eabe7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:39.591463 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6a53c97-ab96-48d7-ab17-c1b55f4eabe7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:39.591997 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6a53c97-ab96-48d7-ab17-c1b55f4eabe7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:39.592719 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c6a53c97-ab96-48d7-ab17-c1b55f4eabe7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:39.631691 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c6a53c97-ab96-48d7-ab17-c1b55f4eabe7 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055915 Sep 13 01:25:39.632278 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 452/896] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:25:39 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:40.645577 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-343eb9c2-e200-4c10-a3aa-afaebbd5b71c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:40.648711 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-343eb9c2-e200-4c10-a3aa-afaebbd5b71c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:40.655325 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-343eb9c2-e200-4c10-a3aa-afaebbd5b71c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:40.655810 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-343eb9c2-e200-4c10-a3aa-afaebbd5b71c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:40.656560 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-343eb9c2-e200-4c10-a3aa-afaebbd5b71c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:40.657324 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-343eb9c2-e200-4c10-a3aa-afaebbd5b71c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:40.657999 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-343eb9c2-e200-4c10-a3aa-afaebbd5b71c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:40.658427 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-343eb9c2-e200-4c10-a3aa-afaebbd5b71c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:40.688650 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-343eb9c2-e200-4c10-a3aa-afaebbd5b71c tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047869 Sep 13 01:25:40.689228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 445/897] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:25:40 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 01:25:40.758186 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-03c63581-5b5f-445b-bead-870cb840aad3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:40.758782 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-03c63581-5b5f-445b-bead-870cb840aad3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:40.765488 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03c63581-5b5f-445b-bead-870cb840aad3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:40.765975 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03c63581-5b5f-445b-bead-870cb840aad3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:40.766402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03c63581-5b5f-445b-bead-870cb840aad3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:40.768713 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03c63581-5b5f-445b-bead-870cb840aad3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:40.769328 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03c63581-5b5f-445b-bead-870cb840aad3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:40.769860 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-03c63581-5b5f-445b-bead-870cb840aad3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:40.797922 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-03c63581-5b5f-445b-bead-870cb840aad3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:25:40.893857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-03c63581-5b5f-445b-bead-870cb840aad3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 204 len: 0 microversion: 2.1 time: 0.140146 Sep 13 01:25:40.898012 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 453/898] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:25:40 2022] DELETE /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:25:40.904009 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-96b65f27-3fe9-44d4-8205-5cefce70a709 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:40.904937 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-96b65f27-3fe9-44d4-8205-5cefce70a709 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:40.910799 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-96b65f27-3fe9-44d4-8205-5cefce70a709 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:40.911536 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-96b65f27-3fe9-44d4-8205-5cefce70a709 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:40.911981 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-96b65f27-3fe9-44d4-8205-5cefce70a709 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:40.913226 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-96b65f27-3fe9-44d4-8205-5cefce70a709 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:40.913684 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-96b65f27-3fe9-44d4-8205-5cefce70a709 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:40.914111 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-96b65f27-3fe9-44d4-8205-5cefce70a709 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:41.119067 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-96b65f27-3fe9-44d4-8205-5cefce70a709 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:41.127651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-96b65f27-3fe9-44d4-8205-5cefce70a709 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1682 microversion: 2.1 time: 0.227974 Sep 13 01:25:41.128540 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 446/899] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:40 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:42.123834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-05a432ff-7880-45cd-834e-822e8b2537be tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Action: 'create', calling method: .version_select at 0x7fb061cd0a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1916310629"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:42.152883 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b0f37f59-c437-4dfd-bb12-eed3c6753427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:42.155256 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b0f37f59-c437-4dfd-bb12-eed3c6753427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:42.164249 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0f37f59-c437-4dfd-bb12-eed3c6753427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:42.165116 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0f37f59-c437-4dfd-bb12-eed3c6753427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:42.165759 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0f37f59-c437-4dfd-bb12-eed3c6753427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:42.166665 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0f37f59-c437-4dfd-bb12-eed3c6753427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:42.167362 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0f37f59-c437-4dfd-bb12-eed3c6753427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:42.167915 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0f37f59-c437-4dfd-bb12-eed3c6753427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:42.327044 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b0f37f59-c437-4dfd-bb12-eed3c6753427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:42.337418 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b0f37f59-c437-4dfd-bb12-eed3c6753427 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1682 microversion: 2.1 time: 0.187282 Sep 13 01:25:42.338866 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 447/900] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:42 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1682 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:25:42.479231 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-05a432ff-7880-45cd-834e-822e8b2537be tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.585333 Sep 13 01:25:42.481902 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 454/901] 10.222.0.15 () {60 vars in 1155 bytes} [Tue Sep 13 01:25:41 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 589 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 13 01:25:42.500228 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a14a961e-82d3-441d-9ce3-c7f365606fd0 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb05e35b040>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:42.574357 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a14a961e-82d3-441d-9ce3-c7f365606fd0 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd" status: 200 len: 345 microversion: 2.1 time: 0.082317 Sep 13 01:25:42.575385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 448/902] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:25:42 2022] GET /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:25:43.331452 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-b62dd85a-28aa-4bd6-8223-1f2f41eb47cf req-97f57b24-8240-4f00-92ee-9344f284d75b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecc43951-6c00-456d-bc95-10f6a0771001", "name": "network-vif-deleted", "tag": "4e09343f-3c4a-4429-8bc0-ccdaffa8df31"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:43.342931 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-b62dd85a-28aa-4bd6-8223-1f2f41eb47cf req-97f57b24-8240-4f00-92ee-9344f284d75b service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:43.343424 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-b62dd85a-28aa-4bd6-8223-1f2f41eb47cf req-97f57b24-8240-4f00-92ee-9344f284d75b service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:43.343874 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-b62dd85a-28aa-4bd6-8223-1f2f41eb47cf req-97f57b24-8240-4f00-92ee-9344f284d75b service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:43.356688 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-b62dd85a-28aa-4bd6-8223-1f2f41eb47cf req-97f57b24-8240-4f00-92ee-9344f284d75b service nova] Creating event network-vif-deleted:4e09343f-3c4a-4429-8bc0-ccdaffa8df31 for instance ecc43951-6c00-456d-bc95-10f6a0771001 on hv-cinder-85694 Sep 13 01:25:43.361699 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-b62dd85a-28aa-4bd6-8223-1f2f41eb47cf req-97f57b24-8240-4f00-92ee-9344f284d75b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034704 Sep 13 01:25:43.362058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-21f94aa0-41ac-446c-8daa-46da42d72e37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:43.362679 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-21f94aa0-41ac-446c-8daa-46da42d72e37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:43.365551 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 455/903] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:43.368922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21f94aa0-41ac-446c-8daa-46da42d72e37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:43.369587 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21f94aa0-41ac-446c-8daa-46da42d72e37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:43.370234 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21f94aa0-41ac-446c-8daa-46da42d72e37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:43.371150 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21f94aa0-41ac-446c-8daa-46da42d72e37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:43.371762 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21f94aa0-41ac-446c-8daa-46da42d72e37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:43.372364 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21f94aa0-41ac-446c-8daa-46da42d72e37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:43.466829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-21f94aa0-41ac-446c-8daa-46da42d72e37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '776733af5b6a4115b2a11d67666a379d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '30ce8239a9b34af685743812ce53ef19', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:43.476338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-21f94aa0-41ac-446c-8daa-46da42d72e37 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 200 len: 1327 microversion: 2.1 time: 0.118798 Sep 13 01:25:43.477368 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 449/904] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:43 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 1327 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:25:43.590545 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4904e620-c069-4850-8fdf-824194b40a5d tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb05e3e2e50>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:43.649001 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4904e620-c069-4850-8fdf-824194b40a5d tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd" status: 200 len: 346 microversion: 2.1 time: 0.062688 Sep 13 01:25:43.649518 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 456/905] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:25:43 2022] GET /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:43.670247 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-be9fa916-7a84-4a72-9b50-81ce954205d6 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Action: 'create', calling method: .version_select at 0x7fb05e27e670>, body: {"snapshot": {"volume_id": "bc66be95-6893-4efb-a019-f37e45d7bfdd", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-615381466"}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:43.845902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-be9fa916-7a84-4a72-9b50-81ce954205d6 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.186721 Sep 13 01:25:43.846674 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 450/906] 10.222.0.15 () {60 vars in 1162 bytes} [Tue Sep 13 01:25:43 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:43.858681 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f72a5008-36a9-4d52-b45b-d08c46ef23a2 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb061cd05e0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:43.908800 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f72a5008-36a9-4d52-b45b-d08c46ef23a2 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58" status: 200 len: 286 microversion: 2.1 time: 0.052796 Sep 13 01:25:43.909435 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 457/907] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 01:25:43 2022] GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58 => generated 286 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:43.923835 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-35226842-a53a-4189-8670-44f634174227 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb05e4d4160>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:43.957989 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-35226842-a53a-4189-8670-44f634174227 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.039881 Sep 13 01:25:43.959146 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 451/908] 10.222.0.15 () {58 vars in 1140 bytes} [Tue Sep 13 01:25:43 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:43.971522 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-acb882e2-74d5-4f1f-8e3f-85278615193a tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb05e370b80>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:44.006495 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-acb882e2-74d5-4f1f-8e3f-85278615193a tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58" status: 200 len: 286 microversion: 2.1 time: 0.038336 Sep 13 01:25:44.007186 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 458/909] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 01:25:43 2022] GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:44.501707 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-15bb5347-9eec-4b51-af3b-e5bf10f5293d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:44.502346 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-15bb5347-9eec-4b51-af3b-e5bf10f5293d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:44.508319 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-15bb5347-9eec-4b51-af3b-e5bf10f5293d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:44.508801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-15bb5347-9eec-4b51-af3b-e5bf10f5293d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:44.509229 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-15bb5347-9eec-4b51-af3b-e5bf10f5293d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:44.509914 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-15bb5347-9eec-4b51-af3b-e5bf10f5293d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:44.510365 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-15bb5347-9eec-4b51-af3b-e5bf10f5293d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:44.510783 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-15bb5347-9eec-4b51-af3b-e5bf10f5293d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:44.523918 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-15bb5347-9eec-4b51-af3b-e5bf10f5293d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-15bb5347-9eec-4b51-af3b-e5bf10f5293d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 HTTP/1.1 Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:44.525530 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:44.527170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:25:44.527170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:44.527170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:44.527170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:44.527170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:44.527170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:44.527170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:44.527170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:25:44.527170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:44.527170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:25:44.527170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:44.527170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': 'ecc43951-6c00-456d-bc95-10f6a0771001'} Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:44.528432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:44.529966 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:44.531470 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-15bb5347-9eec-4b51-af3b-e5bf10f5293d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 404 to user: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:44.531470 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-15bb5347-9eec-4b51-af3b-e5bf10f5293d tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 404 len: 111 microversion: 2.1 time: 0.030178 Sep 13 01:25:44.531470 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 452/910] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:44 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:44.536020 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f7710b1d-de23-4980-a014-7649dad902d5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '.version_select at 0x7fb061cd0b80>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:44.557476 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f7710b1d-de23-4980-a014-7649dad902d5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570457703" status: 202 len: 0 microversion: 2.1 time: 0.025598 Sep 13 01:25:44.558061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 459/911] 10.222.0.15 () {58 vars in 1221 bytes} [Tue Sep 13 01:25:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1570457703 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:25:45.021308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-53ded5ec-a985-4d4c-a2b7-6f4f2cc626a6 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb05e27e940>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:45.070846 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-53ded5ec-a985-4d4c-a2b7-6f4f2cc626a6 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58" status: 200 len: 286 microversion: 2.1 time: 0.054431 Sep 13 01:25:45.071443 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 453/912] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 01:25:45 2022] GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58 => generated 286 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:46.084818 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-83d6f38d-ae1d-49ca-aaa3-ac584c92e5af tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb061cec550>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:46.113495 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-83d6f38d-ae1d-49ca-aaa3-ac584c92e5af tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58" status: 200 len: 286 microversion: 2.1 time: 0.033615 Sep 13 01:25:46.114049 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 460/913] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 01:25:46 2022] GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:47.126934 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d57617b8-e063-42fd-a34a-b34b0d609c51 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb05e2b00d0>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:47.155508 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d57617b8-e063-42fd-a34a-b34b0d609c51 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58" status: 200 len: 287 microversion: 2.1 time: 0.032925 Sep 13 01:25:47.156127 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 454/914] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 01:25:47 2022] GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:47.169693 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7b029f0d-7972-437d-b355-a4a0bc1b3992 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb061ccf310>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:47.228479 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7b029f0d-7972-437d-b355-a4a0bc1b3992 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58" status: 202 len: 0 microversion: 2.1 time: 0.063460 Sep 13 01:25:47.229048 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 461/915] 10.222.0.15 () {58 vars in 1254 bytes} [Tue Sep 13 01:25:47 2022] DELETE /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:25:47.237443 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f91c6af0-188c-4729-8f27-ce3309dbb97f tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb05e23daf0>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:47.270795 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f91c6af0-188c-4729-8f27-ce3309dbb97f tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58" status: 200 len: 286 microversion: 2.1 time: 0.037106 Sep 13 01:25:47.272083 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 455/916] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 01:25:47 2022] GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:48.284585 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-49e3e04a-5ffe-4ef7-95c4-861782f2d634 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb061ce8ee0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:48.314522 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-49e3e04a-5ffe-4ef7-95c4-861782f2d634 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58" status: 200 len: 286 microversion: 2.1 time: 0.034192 Sep 13 01:25:48.315100 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 462/917] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 01:25:48 2022] GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:49.326936 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3b9c65f9-b848-4fcd-bc53-5c692921a882 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb05e3a2dc0>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:49.356393 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3b9c65f9-b848-4fcd-bc53-5c692921a882 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58" status: 200 len: 286 microversion: 2.1 time: 0.033652 Sep 13 01:25:49.357046 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 456/918] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 01:25:49 2022] GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:50.369804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-04b3c5c3-5f3c-4415-a05d-33a5172eab0b tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb05e3e2310>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:50.399257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-04b3c5c3-5f3c-4415-a05d-33a5172eab0b tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] HTTP exception thrown: Snapshot 68bf8a9d-458d-4ff6-ae4b-b1de61611d58 could not be found. Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-04b3c5c3-5f3c-4415-a05d-33a5172eab0b tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Request method failure captured: Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58 HTTP/1.1 Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9wVWcdEkufuglpQEc15KDlg82iQz96oIKozCHqaaIr_N2FyD3co1QIkC-l7ADhusNtxa7YZcveeQcvalvXOcpPFZe0wSjrIS3ztGvCfUPqLvqwLL2Wfsj_moVBk5vjvcul62krLj6iOErTJn3tG0Yxik561Jy8mzmehbkRh8T2YRGs Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 91791df2a5554f08bf5827f346ed5760 Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-269862171 Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:25:50.401806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:25:50.403442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_91791df2a5554f08bf5827f346ed5760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/91791df2a5554f08bf5827f346ed5760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/91791df2a5554f08bf5827f346ed5760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/91791df2a5554f08bf5827f346ed5760"}]}] Sep 13 01:25:50.403442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesSnapshotsTestJSON-269862171 Sep 13 01:25:50.403442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 91791df2a5554f08bf5827f346ed5760 Sep 13 01:25:50.403442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-269862171 Sep 13 01:25:50.403442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesSnapshotsTestJSON-269862171-project Sep 13 01:25:50.403442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:25:50.403442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:25:50.403442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 6b6f3855d9bc48a3b70e01151a36f466 Sep 13 01:25:50.403442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesSnapshotsTestJSON-269862171-project Sep 13 01:25:50.403442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: Sep 13 01:25:50.403442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Snapshot 68bf8a9d-458d-4ff6-ae4b-b1de61611d58 could not be found. Sep 13 01:25:50.403442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '68bf8a9d-458d-4ff6-ae4b-b1de61611d58'} Sep 13 01:25:50.403442 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 68bf8a9d-458d-4ff6-ae4b-b1de61611d58 could not be found. (HTTP 404) (Request-ID: req-f6356b86-e855-4695-b9db-79960c693535) Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.404284 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 01:25:50.405389 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 68bf8a9d-458d-4ff6-ae4b-b1de61611d58 could not be found. Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 13 01:25:50.406553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:50.408286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 68bf8a9d-458d-4ff6-ae4b-b1de61611d58 could not be found. Sep 13 01:25:50.408286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.408286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:50.408286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.408286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:50.408286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:50.408286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:50.408286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:50.408286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:50.408286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 68bf8a9d-458d-4ff6-ae4b-b1de61611d58 could not be found. Sep 13 01:25:50.408286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.410008 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-04b3c5c3-5f3c-4415-a05d-33a5172eab0b tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Returning 404 to user: Snapshot 68bf8a9d-458d-4ff6-ae4b-b1de61611d58 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:50.410881 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-04b3c5c3-5f3c-4415-a05d-33a5172eab0b tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58" status: 404 len: 111 microversion: 2.1 time: 0.045507 Sep 13 01:25:50.411441 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 463/919] 10.222.0.15 () {58 vars in 1251 bytes} [Tue Sep 13 01:25:50 2022] GET /compute/v2.1/os-snapshots/68bf8a9d-458d-4ff6-ae4b-b1de61611d58 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:50.420849 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-124e4b13-5347-4909-b56f-81fa192dff0b tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb05e322940>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:50.492169 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-124e4b13-5347-4909-b56f-81fa192dff0b tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd" status: 202 len: 0 microversion: 2.1 time: 0.075617 Sep 13 01:25:50.492734 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 457/920] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 01:25:50 2022] DELETE /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:25:50.501407 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7e0c5085-caf7-4055-8fff-2b9e0d1bc6a9 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb05e370430>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:50.571184 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7e0c5085-caf7-4055-8fff-2b9e0d1bc6a9 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd" status: 200 len: 345 microversion: 2.1 time: 0.073413 Sep 13 01:25:50.571829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 464/921] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:25:50 2022] GET /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd => generated 345 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:50.579085 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-141ef9ed-583b-4456-870b-3393726c9dd5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:50.579599 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-141ef9ed-583b-4456-870b-3393726c9dd5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:50.586135 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-141ef9ed-583b-4456-870b-3393726c9dd5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:50.586624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-141ef9ed-583b-4456-870b-3393726c9dd5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:50.587200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-141ef9ed-583b-4456-870b-3393726c9dd5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:50.587968 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-141ef9ed-583b-4456-870b-3393726c9dd5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:50.588477 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-141ef9ed-583b-4456-870b-3393726c9dd5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:50.588901 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-141ef9ed-583b-4456-870b-3393726c9dd5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:50.605657 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-141ef9ed-583b-4456-870b-3393726c9dd5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-141ef9ed-583b-4456-870b-3393726c9dd5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: DELETE /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 HTTP/1.1 Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:50.607385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:50.608962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:25:50.608962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:50.608962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:50.608962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:50.608962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:50.608962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:50.608962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:50.608962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:25:50.608962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:50.608962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:25:50.608962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:50.608962 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': 'ecc43951-6c00-456d-bc95-10f6a0771001'} Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:50.609980 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:50.612543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.614043 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-141ef9ed-583b-4456-870b-3393726c9dd5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 404 to user: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:50.614043 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-141ef9ed-583b-4456-870b-3393726c9dd5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 404 len: 111 microversion: 2.1 time: 0.044190 Sep 13 01:25:50.614043 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 458/922] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:25:50 2022] DELETE /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:50.620167 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-277673e5-35bc-4e58-8372-c3e3c1ff7206 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:50.620899 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-277673e5-35bc-4e58-8372-c3e3c1ff7206 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: ecc43951-6c00-456d-bc95-10f6a0771001] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:50.627234 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-277673e5-35bc-4e58-8372-c3e3c1ff7206 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:50.627717 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-277673e5-35bc-4e58-8372-c3e3c1ff7206 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:50.628199 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-277673e5-35bc-4e58-8372-c3e3c1ff7206 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:50.628887 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-277673e5-35bc-4e58-8372-c3e3c1ff7206 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:50.629402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-277673e5-35bc-4e58-8372-c3e3c1ff7206 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:50.629826 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-277673e5-35bc-4e58-8372-c3e3c1ff7206 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:50.643640 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:50.645305 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-277673e5-35bc-4e58-8372-c3e3c1ff7206 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-277673e5-35bc-4e58-8372-c3e3c1ff7206 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 HTTP/1.1 Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:25:50.647098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:25:50.648492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:25:50.648492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:50.648492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:50.648492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:50.648492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:50.648492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:25:50.648492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:25:50.648492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:25:50.648492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:50.648492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:25:50.648492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:50.648492 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': 'ecc43951-6c00-456d-bc95-10f6a0771001'} Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:50.649238 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. Sep 13 01:25:50.650583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:50.651766 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-277673e5-35bc-4e58-8372-c3e3c1ff7206 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 404 to user: Instance ecc43951-6c00-456d-bc95-10f6a0771001 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:50.651766 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-277673e5-35bc-4e58-8372-c3e3c1ff7206 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001" status: 404 len: 111 microversion: 2.1 time: 0.032459 Sep 13 01:25:50.651766 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 465/923] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:50 2022] GET /compute/v2.1/servers/ecc43951-6c00-456d-bc95-10f6a0771001 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:51.586212 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e6723e68-41b1-49d7-9184-bc3a1947d906 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb05e849670>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:51.613946 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-e6723e68-41b1-49d7-9184-bc3a1947d906 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] HTTP exception thrown: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e6723e68-41b1-49d7-9184-bc3a1947d906 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Request method failure captured: Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd HTTP/1.1 Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9wVWcdEkufuglpQEc15KDlg82iQz96oIKozCHqaaIr_N2FyD3co1QIkC-l7ADhusNtxa7YZcveeQcvalvXOcpPFZe0wSjrIS3ztGvCfUPqLvqwLL2Wfsj_moVBk5vjvcul62krLj6iOErTJn3tG0Yxik561Jy8mzmehbkRh8T2YRGs Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 91791df2a5554f08bf5827f346ed5760 Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-269862171 Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:51.615940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:51.617582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_91791df2a5554f08bf5827f346ed5760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/91791df2a5554f08bf5827f346ed5760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/91791df2a5554f08bf5827f346ed5760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/91791df2a5554f08bf5827f346ed5760"}]}] Sep 13 01:25:51.617582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-VolumesSnapshotsTestJSON-269862171 Sep 13 01:25:51.617582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 91791df2a5554f08bf5827f346ed5760 Sep 13 01:25:51.617582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-269862171 Sep 13 01:25:51.617582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-VolumesSnapshotsTestJSON-269862171-project Sep 13 01:25:51.617582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:51.617582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:51.617582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 6b6f3855d9bc48a3b70e01151a36f466 Sep 13 01:25:51.617582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-VolumesSnapshotsTestJSON-269862171-project Sep 13 01:25:51.617582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: Sep 13 01:25:51.617582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.617582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': 'bc66be95-6893-4efb-a019-f37e45d7bfdd'} Sep 13 01:25:51.617582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. (HTTP 404) (Request-ID: req-1049f91a-f37c-40b2-8107-155fe81cb991) Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:51.618768 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 01:25:51.620123 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 01:25:51.621338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e6723e68-41b1-49d7-9184-bc3a1947d906 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Returning 404 to user: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-e6723e68-41b1-49d7-9184-bc3a1947d906 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd" status: 404 len: 109 microversion: 2.1 time: 0.035729 Sep 13 01:25:51.622456 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 459/924] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:25:51 2022] GET /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:51.632173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ebc6d04f-42a1-4399-8b63-b1176332e491 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb061cec790>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:51.671855 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-ebc6d04f-42a1-4399-8b63-b1176332e491 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] HTTP exception thrown: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ebc6d04f-42a1-4399-8b63-b1176332e491 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Request method failure captured: Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd HTTP/1.1 Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9wVWcdEkufuglpQEc15KDlg82iQz96oIKozCHqaaIr_N2FyD3co1QIkC-l7ADhusNtxa7YZcveeQcvalvXOcpPFZe0wSjrIS3ztGvCfUPqLvqwLL2Wfsj_moVBk5vjvcul62krLj6iOErTJn3tG0Yxik561Jy8mzmehbkRh8T2YRGs Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 91791df2a5554f08bf5827f346ed5760 Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-269862171 Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:25:51.673786 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:25:51.675402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_91791df2a5554f08bf5827f346ed5760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/91791df2a5554f08bf5827f346ed5760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/91791df2a5554f08bf5827f346ed5760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/91791df2a5554f08bf5827f346ed5760"}]}] Sep 13 01:25:51.675402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesSnapshotsTestJSON-269862171 Sep 13 01:25:51.675402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 91791df2a5554f08bf5827f346ed5760 Sep 13 01:25:51.675402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-269862171 Sep 13 01:25:51.675402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesSnapshotsTestJSON-269862171-project Sep 13 01:25:51.675402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:25:51.675402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:25:51.675402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 6b6f3855d9bc48a3b70e01151a36f466 Sep 13 01:25:51.675402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesSnapshotsTestJSON-269862171-project Sep 13 01:25:51.675402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: Sep 13 01:25:51.675402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.675402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': 'bc66be95-6893-4efb-a019-f37e45d7bfdd'} Sep 13 01:25:51.675402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. (HTTP 404) (Request-ID: req-8852a27a-5bd9-436b-92d3-bf507954f267) Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:51.676364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 13 01:25:51.678416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 13 01:25:51.680204 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ebc6d04f-42a1-4399-8b63-b1176332e491 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Returning 404 to user: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ebc6d04f-42a1-4399-8b63-b1176332e491 tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd" status: 404 len: 109 microversion: 2.1 time: 0.047355 Sep 13 01:25:51.681672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 466/925] 10.222.0.15 () {58 vars in 1248 bytes} [Tue Sep 13 01:25:51 2022] DELETE /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:51.687219 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-629f90e1-f5f8-466e-8cf4-5496861d9a0d tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Calling method '.version_select at 0x7fb05e322700>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:51.715215 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-629f90e1-f5f8-466e-8cf4-5496861d9a0d tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] HTTP exception thrown: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-629f90e1-f5f8-466e-8cf4-5496861d9a0d tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Request method failure captured: Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd HTTP/1.1 Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9wVWcdEkufuglpQEc15KDlg82iQz96oIKozCHqaaIr_N2FyD3co1QIkC-l7ADhusNtxa7YZcveeQcvalvXOcpPFZe0wSjrIS3ztGvCfUPqLvqwLL2Wfsj_moVBk5vjvcul62krLj6iOErTJn3tG0Yxik561Jy8mzmehbkRh8T2YRGs Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 91791df2a5554f08bf5827f346ed5760 Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-269862171 Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:51.717144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:51.718703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_91791df2a5554f08bf5827f346ed5760"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/91791df2a5554f08bf5827f346ed5760"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/91791df2a5554f08bf5827f346ed5760"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/91791df2a5554f08bf5827f346ed5760"}]}] Sep 13 01:25:51.718703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-VolumesSnapshotsTestJSON-269862171 Sep 13 01:25:51.718703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 91791df2a5554f08bf5827f346ed5760 Sep 13 01:25:51.718703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-269862171 Sep 13 01:25:51.718703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-VolumesSnapshotsTestJSON-269862171-project Sep 13 01:25:51.718703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:51.718703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:51.718703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 6b6f3855d9bc48a3b70e01151a36f466 Sep 13 01:25:51.718703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-VolumesSnapshotsTestJSON-269862171-project Sep 13 01:25:51.718703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: Sep 13 01:25:51.718703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.718703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': 'bc66be95-6893-4efb-a019-f37e45d7bfdd'} Sep 13 01:25:51.718703 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. (HTTP 404) (Request-ID: req-f7471b5f-6667-4b78-a9e5-f826f7a66b80) Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:51.719892 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 13 01:25:51.721293 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 13 01:25:51.722798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-629f90e1-f5f8-466e-8cf4-5496861d9a0d tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] Returning 404 to user: Volume bc66be95-6893-4efb-a019-f37e45d7bfdd could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-629f90e1-f5f8-466e-8cf4-5496861d9a0d tempest-VolumesSnapshotsTestJSON-269862171 tempest-VolumesSnapshotsTestJSON-269862171-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd" status: 404 len: 109 microversion: 2.1 time: 0.037872 Sep 13 01:25:51.724207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 460/926] 10.222.0.15 () {58 vars in 1245 bytes} [Tue Sep 13 01:25:51 2022] GET /compute/v2.1/os-volumes/bc66be95-6893-4efb-a019-f37e45d7bfdd => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 01:25:52.856015 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7cbf8219-e7f9-46ad-bbf7-1e0b0e310a7b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:52.856581 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7cbf8219-e7f9-46ad-bbf7-1e0b0e310a7b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:52.863608 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7cbf8219-e7f9-46ad-bbf7-1e0b0e310a7b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:52.864175 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7cbf8219-e7f9-46ad-bbf7-1e0b0e310a7b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:52.864612 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7cbf8219-e7f9-46ad-bbf7-1e0b0e310a7b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:52.865993 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7cbf8219-e7f9-46ad-bbf7-1e0b0e310a7b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:52.866432 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7cbf8219-e7f9-46ad-bbf7-1e0b0e310a7b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:52.866869 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7cbf8219-e7f9-46ad-bbf7-1e0b0e310a7b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:52.881054 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-7cbf8219-e7f9-46ad-bbf7-1e0b0e310a7b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7cbf8219-e7f9-46ad-bbf7-1e0b0e310a7b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 HTTP/1.1 Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:25:52.882635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:25:52.884061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:25:52.884061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:52.884061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:52.884061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:52.884061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:52.884061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:25:52.884061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:25:52.884061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:25:52.884061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:52.884061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:25:52.884061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:25:52.884061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '4334e1fb-8fd8-47e4-a1dd-fb08c0b83480'} Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:52.884834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:25:52.886131 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.888386 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7cbf8219-e7f9-46ad-bbf7-1e0b0e310a7b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 404 to user: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:52.888386 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7cbf8219-e7f9-46ad-bbf7-1e0b0e310a7b tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 404 len: 111 microversion: 2.1 time: 0.032924 Sep 13 01:25:52.888386 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 467/927] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:25:52 2022] DELETE /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:52.893299 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-65a08191-599a-406c-b940-4a4c59455968 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:52.893924 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-65a08191-599a-406c-b940-4a4c59455968 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:52.905945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65a08191-599a-406c-b940-4a4c59455968 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:52.906715 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65a08191-599a-406c-b940-4a4c59455968 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:52.907211 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65a08191-599a-406c-b940-4a4c59455968 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:52.907929 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65a08191-599a-406c-b940-4a4c59455968 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:52.908390 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65a08191-599a-406c-b940-4a4c59455968 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:52.909180 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65a08191-599a-406c-b940-4a4c59455968 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:52.922697 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-65a08191-599a-406c-b940-4a4c59455968 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-65a08191-599a-406c-b940-4a4c59455968 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 HTTP/1.1 Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:52.924531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:52.926056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:25:52.926056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:52.926056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:52.926056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:52.926056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:52.926056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:52.926056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:52.926056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:25:52.926056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:52.926056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:25:52.926056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:25:52.926056 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '4334e1fb-8fd8-47e4-a1dd-fb08c0b83480'} Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:52.927159 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. Sep 13 01:25:52.929176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.933911 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-65a08191-599a-406c-b940-4a4c59455968 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 404 to user: Instance 4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:52.933911 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-65a08191-599a-406c-b940-4a4c59455968 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480" status: 404 len: 111 microversion: 2.1 time: 0.040093 Sep 13 01:25:52.933911 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 461/928] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:52 2022] GET /compute/v2.1/servers/4334e1fb-8fd8-47e4-a1dd-fb08c0b83480 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:52.937643 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-19501e79-b044-49be-b574-ba96a04b7be5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:52.938140 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-19501e79-b044-49be-b574-ba96a04b7be5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:52.944501 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-19501e79-b044-49be-b574-ba96a04b7be5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:52.945033 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-19501e79-b044-49be-b574-ba96a04b7be5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:52.945471 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-19501e79-b044-49be-b574-ba96a04b7be5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:52.946999 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-19501e79-b044-49be-b574-ba96a04b7be5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:52.946999 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-19501e79-b044-49be-b574-ba96a04b7be5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:52.947203 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-19501e79-b044-49be-b574-ba96a04b7be5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:52.962287 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-19501e79-b044-49be-b574-ba96a04b7be5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-19501e79-b044-49be-b574-ba96a04b7be5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 HTTP/1.1 Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:25:52.963857 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:25:52.965456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:25:52.965456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:52.965456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:52.965456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:52.965456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:52.965456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:25:52.965456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:25:52.965456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:25:52.965456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:52.965456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:25:52.965456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:25:52.965456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': 'c255cb11-a9fd-46ce-8618-2177ad7f3f76'} Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:52.966346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:25:52.967804 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:25:52.969453 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-19501e79-b044-49be-b574-ba96a04b7be5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 404 to user: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:52.969453 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-19501e79-b044-49be-b574-ba96a04b7be5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 404 len: 111 microversion: 2.1 time: 0.031802 Sep 13 01:25:52.969453 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 468/929] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:25:52 2022] DELETE /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 01:25:52.979058 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-db5e876d-8fe8-4555-9ecb-19d59ce785e3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:52.980206 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-db5e876d-8fe8-4555-9ecb-19d59ce785e3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: c255cb11-a9fd-46ce-8618-2177ad7f3f76] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:52.986166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-db5e876d-8fe8-4555-9ecb-19d59ce785e3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:52.986653 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-db5e876d-8fe8-4555-9ecb-19d59ce785e3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:52.987129 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-db5e876d-8fe8-4555-9ecb-19d59ce785e3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:52.987819 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-db5e876d-8fe8-4555-9ecb-19d59ce785e3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:52.988300 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-db5e876d-8fe8-4555-9ecb-19d59ce785e3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:52.988740 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-db5e876d-8fe8-4555-9ecb-19d59ce785e3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:53.002592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-db5e876d-8fe8-4555-9ecb-19d59ce785e3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-db5e876d-8fe8-4555-9ecb-19d59ce785e3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 HTTP/1.1 Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:53.004155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:53.005797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:25:53.005797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:53.005797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:53.005797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:53.005797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:53.005797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:53.005797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:53.005797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:25:53.005797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:53.005797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:25:53.005797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:25:53.005797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': 'c255cb11-a9fd-46ce-8618-2177ad7f3f76'} Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:53.006671 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. Sep 13 01:25:53.008200 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:53.009481 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-db5e876d-8fe8-4555-9ecb-19d59ce785e3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 404 to user: Instance c255cb11-a9fd-46ce-8618-2177ad7f3f76 could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:53.009481 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-db5e876d-8fe8-4555-9ecb-19d59ce785e3 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76" status: 404 len: 111 microversion: 2.1 time: 0.031406 Sep 13 01:25:53.009481 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 462/930] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:52 2022] GET /compute/v2.1/servers/c255cb11-a9fd-46ce-8618-2177ad7f3f76 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:25:53.982334 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1745622375", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1305807284", "security_groups": [{"name": "tempest-secgroup-smoke-161750292"}], "block_device_mapping_v2": [{"uuid": "ddbc82f2-b614-4795-b2df-d270e2c7c171", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "0a90ed41-eeae-4dbf-a9a3-4da26905e9e8"}]}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:54.124621 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] validate_networks() for [('0a90ed41-eeae-4dbf-a9a3-4da26905e9e8', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:25:54.150673 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8455b110-5d00-4d92-b11d-9760d62f23f5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:54.151215 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-8455b110-5d00-4d92-b11d-9760d62f23f5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:54.157909 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8455b110-5d00-4d92-b11d-9760d62f23f5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:54.158595 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8455b110-5d00-4d92-b11d-9760d62f23f5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:54.159070 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8455b110-5d00-4d92-b11d-9760d62f23f5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:54.160290 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8455b110-5d00-4d92-b11d-9760d62f23f5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:54.160950 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8455b110-5d00-4d92-b11d-9760d62f23f5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:54.161383 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8455b110-5d00-4d92-b11d-9760d62f23f5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:54.178578 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-8455b110-5d00-4d92-b11d-9760d62f23f5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8455b110-5d00-4d92-b11d-9760d62f23f5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: DELETE /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab HTTP/1.1 Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:54.180448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:54.181888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:25:54.181888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:54.181888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:54.181888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:54.181888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:54.181888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:54.181888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:54.181888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:25:54.181888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:54.181888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:25:54.181888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:25:54.181888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '47f2cc02-f632-47e6-8eae-b39a67ec2bab'} Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:54.182652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:25:54.183922 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:54.185234 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8455b110-5d00-4d92-b11d-9760d62f23f5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 404 to user: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:54.185234 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-8455b110-5d00-4d92-b11d-9760d62f23f5 tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "DELETE /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 404 len: 111 microversion: 2.1 time: 0.035690 Sep 13 01:25:54.185234 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 463/931] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:25:54 2022] DELETE /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 01:25:54.190188 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e71b40d5-eb7e-451e-a800-e2317d651c7e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:54.190803 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-e71b40d5-eb7e-451e-a800-e2317d651c7e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] [instance: 47f2cc02-f632-47e6-8eae-b39a67ec2bab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:54.197253 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e71b40d5-eb7e-451e-a800-e2317d651c7e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:54.197753 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e71b40d5-eb7e-451e-a800-e2317d651c7e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:54.198198 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e71b40d5-eb7e-451e-a800-e2317d651c7e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:54.198936 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e71b40d5-eb7e-451e-a800-e2317d651c7e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:54.199399 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e71b40d5-eb7e-451e-a800-e2317d651c7e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:54.199834 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-e71b40d5-eb7e-451e-a800-e2317d651c7e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:54.215028 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-e71b40d5-eb7e-451e-a800-e2317d651c7e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] HTTP exception thrown: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e71b40d5-eb7e-451e-a800-e2317d651c7e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Request method failure captured: Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab HTTP/1.1 Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9rLqeXuVdA3vM-HX_fbPu-LpkSW963zk-byMuJPEfFhkgVP-jlzBNLEhCUBQbfix-5tnD6-0KrKYADR21egXahisMv6P2A8zanCh1VZo1zZeVe9ibIUh1KlWD0zhqoZNMrGh09w68_l8fSI36IE_pivIr6_nHve58-Z7Go-K8kB62Y Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:25:54.216791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:25:54.219592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_30ce8239a9b34af685743812ce53ef19"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/30ce8239a9b34af685743812ce53ef19"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/30ce8239a9b34af685743812ce53ef19"}]}] Sep 13 01:25:54.219592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:54.219592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 30ce8239a9b34af685743812ce53ef19 Sep 13 01:25:54.219592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-824339547 Sep 13 01:25:54.219592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:54.219592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:25:54.219592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:25:54.219592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 776733af5b6a4115b2a11d67666a379d Sep 13 01:25:54.219592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-AttachVolumeNegativeTest-824339547-project Sep 13 01:25:54.219592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:25:54.219592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:25:54.219592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '47f2cc02-f632-47e6-8eae-b39a67ec2bab'} Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:25:54.221742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. Sep 13 01:25:54.223588 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:25:54.225953 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-e71b40d5-eb7e-451e-a800-e2317d651c7e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] Returning 404 to user: Instance 47f2cc02-f632-47e6-8eae-b39a67ec2bab could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:25:54.226497 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-e71b40d5-eb7e-451e-a800-e2317d651c7e tempest-AttachVolumeNegativeTest-824339547 tempest-AttachVolumeNegativeTest-824339547-project] 10.222.0.15 "GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab" status: 404 len: 111 microversion: 2.1 time: 0.037012 Sep 13 01:25:54.230803 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 464/932] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:54 2022] GET /compute/v2.1/servers/47f2cc02-f632-47e6-8eae-b39a67ec2bab => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 01:25:54.587218 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:25:54.588464 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:25:54.589409 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:25:54.589934 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:25:54.590623 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:25:54.600076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:54.600668 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:54.601185 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:54.602014 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:54.602479 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:54.602930 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:54.622596 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Getting quotas for project 66cdd4ec03ea4fbf959ede65bb96f6ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:25:54.628080 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Getting quotas for user 2842b222fe6b4821a670d13ec8febf1a and project 66cdd4ec03ea4fbf959ede65bb96f6ca. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:25:54.688240 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:25:54.690497 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ddbc82f2-b614-4795-b2df-d270e2c7c171',volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:25:54.826631 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a075f609-b1af-4f8a-acc4-1e36e27ec429 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.848400 Sep 13 01:25:54.827553 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 469/933] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:25:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 850 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 01:25:54.840090 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-bcb476b3-fd1a-48da-85c7-f468e000aa48 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:54.840611 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-bcb476b3-fd1a-48da-85c7-f468e000aa48 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:54.937926 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-bcb476b3-fd1a-48da-85c7-f468e000aa48 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:54.946260 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-bcb476b3-fd1a-48da-85c7-f468e000aa48 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1095 microversion: 2.1 time: 0.109851 Sep 13 01:25:54.949873 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 465/934] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:54 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1095 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:55.982506 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0c2784c9-08b2-448f-83cf-77a6d64a7d98 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:55.983247 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0c2784c9-08b2-448f-83cf-77a6d64a7d98 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:55.991978 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c2784c9-08b2-448f-83cf-77a6d64a7d98 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:55.992763 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c2784c9-08b2-448f-83cf-77a6d64a7d98 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:55.993351 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c2784c9-08b2-448f-83cf-77a6d64a7d98 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:55.994437 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c2784c9-08b2-448f-83cf-77a6d64a7d98 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:55.994931 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c2784c9-08b2-448f-83cf-77a6d64a7d98 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:55.996105 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0c2784c9-08b2-448f-83cf-77a6d64a7d98 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:56.093730 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0c2784c9-08b2-448f-83cf-77a6d64a7d98 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:56.102145 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0c2784c9-08b2-448f-83cf-77a6d64a7d98 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1193 microversion: 2.1 time: 0.132419 Sep 13 01:25:56.102722 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 470/935] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:55 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1193 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:57.125461 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8e7ee373-cbc7-431f-8c9f-c2e061858fe7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:57.126071 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-8e7ee373-cbc7-431f-8c9f-c2e061858fe7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:57.133431 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8e7ee373-cbc7-431f-8c9f-c2e061858fe7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:57.133932 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8e7ee373-cbc7-431f-8c9f-c2e061858fe7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:57.134461 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8e7ee373-cbc7-431f-8c9f-c2e061858fe7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:57.135189 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8e7ee373-cbc7-431f-8c9f-c2e061858fe7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:57.135934 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8e7ee373-cbc7-431f-8c9f-c2e061858fe7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:57.136268 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8e7ee373-cbc7-431f-8c9f-c2e061858fe7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:57.452779 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-8e7ee373-cbc7-431f-8c9f-c2e061858fe7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:57.461778 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-8e7ee373-cbc7-431f-8c9f-c2e061858fe7 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.340043 Sep 13 01:25:57.462543 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 466/936] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:57 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:58.372066 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-076aab94-ee19-4002-a0e3-13f2518d9e98 req-f20e97b5-9a05-4917-83be-94d28515dea0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9685ccea-9ac8-4b1b-9311-2b67570eed43", "tag": "75f99f30-6170-4344-b9f7-a80eeee96ba2"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:25:58.388835 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-076aab94-ee19-4002-a0e3-13f2518d9e98 req-f20e97b5-9a05-4917-83be-94d28515dea0 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:58.389564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-076aab94-ee19-4002-a0e3-13f2518d9e98 req-f20e97b5-9a05-4917-83be-94d28515dea0 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:58.390247 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-076aab94-ee19-4002-a0e3-13f2518d9e98 req-f20e97b5-9a05-4917-83be-94d28515dea0 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:58.406012 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-076aab94-ee19-4002-a0e3-13f2518d9e98 req-f20e97b5-9a05-4917-83be-94d28515dea0 service nova] Creating event network-changed:75f99f30-6170-4344-b9f7-a80eeee96ba2 for instance 9685ccea-9ac8-4b1b-9311-2b67570eed43 on hv-cinder-85694 Sep 13 01:25:58.414623 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-076aab94-ee19-4002-a0e3-13f2518d9e98 req-f20e97b5-9a05-4917-83be-94d28515dea0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046157 Sep 13 01:25:58.415299 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 471/937] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:25:58.491267 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-64367deb-560d-4968-8710-27f107a06b75 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:58.495775 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-64367deb-560d-4968-8710-27f107a06b75 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:58.503575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-64367deb-560d-4968-8710-27f107a06b75 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:58.504926 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-64367deb-560d-4968-8710-27f107a06b75 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:58.506757 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-64367deb-560d-4968-8710-27f107a06b75 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:58.507818 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-64367deb-560d-4968-8710-27f107a06b75 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:58.509569 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-64367deb-560d-4968-8710-27f107a06b75 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:58.510734 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-64367deb-560d-4968-8710-27f107a06b75 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:58.845257 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-64367deb-560d-4968-8710-27f107a06b75 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:25:58.862176 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-64367deb-560d-4968-8710-27f107a06b75 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.376551 Sep 13 01:25:58.867040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 467/938] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:58 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:25:59.889199 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5de2e4ff-2294-4502-a722-ba00d30e5f4d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:25:59.889672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5de2e4ff-2294-4502-a722-ba00d30e5f4d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:25:59.892055 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:25:59.914249 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5de2e4ff-2294-4502-a722-ba00d30e5f4d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:59.915163 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5de2e4ff-2294-4502-a722-ba00d30e5f4d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:59.917781 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5de2e4ff-2294-4502-a722-ba00d30e5f4d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:25:59.918707 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5de2e4ff-2294-4502-a722-ba00d30e5f4d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:25:59.919322 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5de2e4ff-2294-4502-a722-ba00d30e5f4d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:25:59.919828 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5de2e4ff-2294-4502-a722-ba00d30e5f4d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:00.152699 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5de2e4ff-2294-4502-a722-ba00d30e5f4d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:00.168609 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5de2e4ff-2294-4502-a722-ba00d30e5f4d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.286573 Sep 13 01:26:00.171898 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 472/939] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:25:59 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:26:01.198813 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ccd9fecf-9407-4f8a-bd76-fc6fe613ee77 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:26:01.199453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ccd9fecf-9407-4f8a-bd76-fc6fe613ee77 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:26:01.205762 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=44 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:01.207270 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ccd9fecf-9407-4f8a-bd76-fc6fe613ee77 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:01.207777 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ccd9fecf-9407-4f8a-bd76-fc6fe613ee77 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:01.208375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ccd9fecf-9407-4f8a-bd76-fc6fe613ee77 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:01.209392 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ccd9fecf-9407-4f8a-bd76-fc6fe613ee77 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:01.210054 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ccd9fecf-9407-4f8a-bd76-fc6fe613ee77 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:01.210780 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ccd9fecf-9407-4f8a-bd76-fc6fe613ee77 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:01.233049 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:01.355442 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ccd9fecf-9407-4f8a-bd76-fc6fe613ee77 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:01.363484 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ccd9fecf-9407-4f8a-bd76-fc6fe613ee77 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.168684 Sep 13 01:26:01.363994 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 468/940] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:26:01 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:26:02.386552 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bc249310-354c-4d3a-bc7c-ba925d4f8d35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:26:02.387995 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bc249310-354c-4d3a-bc7c-ba925d4f8d35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:26:02.395027 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc249310-354c-4d3a-bc7c-ba925d4f8d35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:02.396362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc249310-354c-4d3a-bc7c-ba925d4f8d35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:02.396903 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc249310-354c-4d3a-bc7c-ba925d4f8d35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:02.397767 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc249310-354c-4d3a-bc7c-ba925d4f8d35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:02.398121 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc249310-354c-4d3a-bc7c-ba925d4f8d35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:02.413951 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc249310-354c-4d3a-bc7c-ba925d4f8d35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:02.626308 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bc249310-354c-4d3a-bc7c-ba925d4f8d35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:02.633314 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bc249310-354c-4d3a-bc7c-ba925d4f8d35 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.250494 Sep 13 01:26:02.634029 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 473/941] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:26:02 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:26:03.654939 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c0481af2-6d6b-4af0-a9d5-18512b72338b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:26:03.655573 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c0481af2-6d6b-4af0-a9d5-18512b72338b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:26:03.662722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c0481af2-6d6b-4af0-a9d5-18512b72338b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:03.663250 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c0481af2-6d6b-4af0-a9d5-18512b72338b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:03.663693 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c0481af2-6d6b-4af0-a9d5-18512b72338b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:03.664400 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c0481af2-6d6b-4af0-a9d5-18512b72338b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:03.664860 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c0481af2-6d6b-4af0-a9d5-18512b72338b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:03.665288 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c0481af2-6d6b-4af0-a9d5-18512b72338b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:03.800643 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c0481af2-6d6b-4af0-a9d5-18512b72338b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:03.809163 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c0481af2-6d6b-4af0-a9d5-18512b72338b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.158239 Sep 13 01:26:03.822935 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 469/942] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:26:03 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:26:04.834788 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-5616b1ac-1965-423c-a473-2a205de9b923 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:26:04.836105 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-5616b1ac-1965-423c-a473-2a205de9b923 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:26:04.838764 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:04.839545 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=6 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:04.845672 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5616b1ac-1965-423c-a473-2a205de9b923 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:04.846119 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5616b1ac-1965-423c-a473-2a205de9b923 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:04.846579 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5616b1ac-1965-423c-a473-2a205de9b923 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:04.847310 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5616b1ac-1965-423c-a473-2a205de9b923 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:04.847762 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5616b1ac-1965-423c-a473-2a205de9b923 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:04.848215 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-5616b1ac-1965-423c-a473-2a205de9b923 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:04.980114 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-5616b1ac-1965-423c-a473-2a205de9b923 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:04.988262 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-5616b1ac-1965-423c-a473-2a205de9b923 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.159665 Sep 13 01:26:04.988845 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 474/943] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:26:04 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:26:06.012163 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1d374854-c096-4813-9a8c-01ac4f1df822 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:26:06.012774 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1d374854-c096-4813-9a8c-01ac4f1df822 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:26:06.015065 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:26:06.020611 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1d374854-c096-4813-9a8c-01ac4f1df822 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:06.021094 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1d374854-c096-4813-9a8c-01ac4f1df822 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:06.021531 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1d374854-c096-4813-9a8c-01ac4f1df822 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:06.022240 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1d374854-c096-4813-9a8c-01ac4f1df822 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:06.022675 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1d374854-c096-4813-9a8c-01ac4f1df822 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:06.023122 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1d374854-c096-4813-9a8c-01ac4f1df822 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:06.154101 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1d374854-c096-4813-9a8c-01ac4f1df822 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:06.161726 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1d374854-c096-4813-9a8c-01ac4f1df822 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.153457 Sep 13 01:26:06.162621 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 470/944] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:26:06 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:26:07.188029 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-747d3207-1787-44f7-8943-1c50a1e0d146 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:26:07.188609 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-747d3207-1787-44f7-8943-1c50a1e0d146 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:26:07.195293 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-747d3207-1787-44f7-8943-1c50a1e0d146 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:07.195776 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-747d3207-1787-44f7-8943-1c50a1e0d146 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:07.196206 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-747d3207-1787-44f7-8943-1c50a1e0d146 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:07.196892 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-747d3207-1787-44f7-8943-1c50a1e0d146 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:07.197350 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-747d3207-1787-44f7-8943-1c50a1e0d146 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:07.197768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-747d3207-1787-44f7-8943-1c50a1e0d146 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:07.328205 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-747d3207-1787-44f7-8943-1c50a1e0d146 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:07.336426 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-747d3207-1787-44f7-8943-1c50a1e0d146 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.152718 Sep 13 01:26:07.336978 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 475/945] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:26:07 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:26:08.417558 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-303186cd-2566-4dff-ad12-998804f34ee8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:26:08.420477 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-303186cd-2566-4dff-ad12-998804f34ee8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:26:08.435182 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-303186cd-2566-4dff-ad12-998804f34ee8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:08.435182 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-303186cd-2566-4dff-ad12-998804f34ee8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:08.435182 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-303186cd-2566-4dff-ad12-998804f34ee8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:08.435182 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-303186cd-2566-4dff-ad12-998804f34ee8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:08.435610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-303186cd-2566-4dff-ad12-998804f34ee8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:08.435610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-303186cd-2566-4dff-ad12-998804f34ee8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:08.574259 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-303186cd-2566-4dff-ad12-998804f34ee8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:08.583230 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-303186cd-2566-4dff-ad12-998804f34ee8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.170964 Sep 13 01:26:08.584578 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 471/946] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:26:08 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:26:09.606457 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-cc696072-734a-4d62-944e-cfa6bf7962d3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:26:09.607027 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-cc696072-734a-4d62-944e-cfa6bf7962d3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:26:09.613521 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc696072-734a-4d62-944e-cfa6bf7962d3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:09.614093 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc696072-734a-4d62-944e-cfa6bf7962d3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:09.614639 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc696072-734a-4d62-944e-cfa6bf7962d3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:09.616034 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc696072-734a-4d62-944e-cfa6bf7962d3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:09.616684 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc696072-734a-4d62-944e-cfa6bf7962d3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:09.617115 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-cc696072-734a-4d62-944e-cfa6bf7962d3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:09.747066 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-cc696072-734a-4d62-944e-cfa6bf7962d3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:09.754757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-cc696072-734a-4d62-944e-cfa6bf7962d3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.152272 Sep 13 01:26:09.755633 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 476/947] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:26:09 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:26:10.777973 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-48a04560-b226-4ff0-9d29-127c18f04901 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:26:10.779600 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-48a04560-b226-4ff0-9d29-127c18f04901 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:26:10.786389 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48a04560-b226-4ff0-9d29-127c18f04901 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:10.787772 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48a04560-b226-4ff0-9d29-127c18f04901 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:10.788216 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48a04560-b226-4ff0-9d29-127c18f04901 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:10.788920 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48a04560-b226-4ff0-9d29-127c18f04901 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:10.789486 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48a04560-b226-4ff0-9d29-127c18f04901 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:10.789923 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-48a04560-b226-4ff0-9d29-127c18f04901 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:10.927294 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-48a04560-b226-4ff0-9d29-127c18f04901 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:10.935721 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-48a04560-b226-4ff0-9d29-127c18f04901 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.162258 Sep 13 01:26:10.936289 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 472/948] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:26:10 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:26:11.933507 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-6e674cde-1d7e-433b-b8e5-d42128377e3e req-ca2bdba7-c2d5-4b1b-a005-b12b42c80f00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9685ccea-9ac8-4b1b-9311-2b67570eed43", "name": "network-vif-plugged", "status": "completed", "tag": "75f99f30-6170-4344-b9f7-a80eeee96ba2"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:26:11.945548 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6e674cde-1d7e-433b-b8e5-d42128377e3e req-ca2bdba7-c2d5-4b1b-a005-b12b42c80f00 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:11.946338 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6e674cde-1d7e-433b-b8e5-d42128377e3e req-ca2bdba7-c2d5-4b1b-a005-b12b42c80f00 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:11.946844 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-6e674cde-1d7e-433b-b8e5-d42128377e3e req-ca2bdba7-c2d5-4b1b-a005-b12b42c80f00 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:11.958252 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ecd8e7a6-61e9-48e5-8eca-043ee2acff13 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:26:11.960076 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ecd8e7a6-61e9-48e5-8eca-043ee2acff13 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:26:11.971132 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ecd8e7a6-61e9-48e5-8eca-043ee2acff13 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:11.971663 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ecd8e7a6-61e9-48e5-8eca-043ee2acff13 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:11.972110 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ecd8e7a6-61e9-48e5-8eca-043ee2acff13 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:11.972832 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ecd8e7a6-61e9-48e5-8eca-043ee2acff13 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:11.973310 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ecd8e7a6-61e9-48e5-8eca-043ee2acff13 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:11.977045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ecd8e7a6-61e9-48e5-8eca-043ee2acff13 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:11.983474 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-6e674cde-1d7e-433b-b8e5-d42128377e3e req-ca2bdba7-c2d5-4b1b-a005-b12b42c80f00 service nova] Creating event network-vif-plugged:75f99f30-6170-4344-b9f7-a80eeee96ba2 for instance 9685ccea-9ac8-4b1b-9311-2b67570eed43 on hv-cinder-85694 Sep 13 01:26:11.993772 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-6e674cde-1d7e-433b-b8e5-d42128377e3e req-ca2bdba7-c2d5-4b1b-a005-b12b42c80f00 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067883 Sep 13 01:26:11.995412 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 477/949] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:26:12.160960 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ecd8e7a6-61e9-48e5-8eca-043ee2acff13 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:12.185086 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ecd8e7a6-61e9-48e5-8eca-043ee2acff13 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.230702 Sep 13 01:26:12.186013 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 473/950] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:26:11 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:26:13.210439 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f97c1c54-95d1-41e1-8ef4-e6a2a5c50dc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:26:13.211225 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f97c1c54-95d1-41e1-8ef4-e6a2a5c50dc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:26:13.218409 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f97c1c54-95d1-41e1-8ef4-e6a2a5c50dc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:13.219250 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f97c1c54-95d1-41e1-8ef4-e6a2a5c50dc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:13.219889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f97c1c54-95d1-41e1-8ef4-e6a2a5c50dc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:13.221502 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f97c1c54-95d1-41e1-8ef4-e6a2a5c50dc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:13.222195 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f97c1c54-95d1-41e1-8ef4-e6a2a5c50dc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:13.222965 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f97c1c54-95d1-41e1-8ef4-e6a2a5c50dc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:13.379336 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-f97c1c54-95d1-41e1-8ef4-e6a2a5c50dc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:13.387411 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f97c1c54-95d1-41e1-8ef4-e6a2a5c50dc8 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1266 microversion: 2.1 time: 0.181503 Sep 13 01:26:13.387983 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 478/951] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:26:13 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1266 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:26:14.416498 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0459ea80-bf2f-4893-b33c-dd64a1aa1d84 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:26:14.417124 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0459ea80-bf2f-4893-b33c-dd64a1aa1d84 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:26:14.425630 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0459ea80-bf2f-4893-b33c-dd64a1aa1d84 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:14.426166 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0459ea80-bf2f-4893-b33c-dd64a1aa1d84 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:14.426552 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0459ea80-bf2f-4893-b33c-dd64a1aa1d84 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:14.427316 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0459ea80-bf2f-4893-b33c-dd64a1aa1d84 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:14.427772 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0459ea80-bf2f-4893-b33c-dd64a1aa1d84 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:14.428193 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0459ea80-bf2f-4893-b33c-dd64a1aa1d84 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:14.581623 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0459ea80-bf2f-4893-b33c-dd64a1aa1d84 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:14.590715 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0459ea80-bf2f-4893-b33c-dd64a1aa1d84 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1454 microversion: 2.1 time: 0.181978 Sep 13 01:26:14.591634 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 474/952] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:26:14 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1454 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:26:14.617334 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c1d9a760-ee31-47ec-a60f-5a42f89895d0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:26:14.617938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c1d9a760-ee31-47ec-a60f-5a42f89895d0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:26:14.625456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c1d9a760-ee31-47ec-a60f-5a42f89895d0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:14.626580 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c1d9a760-ee31-47ec-a60f-5a42f89895d0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:14.627240 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c1d9a760-ee31-47ec-a60f-5a42f89895d0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:14.628124 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c1d9a760-ee31-47ec-a60f-5a42f89895d0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:14.628580 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c1d9a760-ee31-47ec-a60f-5a42f89895d0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:14.629000 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c1d9a760-ee31-47ec-a60f-5a42f89895d0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:14.793653 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c1d9a760-ee31-47ec-a60f-5a42f89895d0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:26:14.802926 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c1d9a760-ee31-47ec-a60f-5a42f89895d0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1454 microversion: 2.1 time: 0.189624 Sep 13 01:26:14.803761 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 479/953] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:26:14 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1454 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:26:16.811650 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-5e49244d-6482-4965-98e0-f06f8dec9739 req-1d1c697b-ab65-4dc3-a154-94cc5b34dca6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9685ccea-9ac8-4b1b-9311-2b67570eed43", "tag": "75f99f30-6170-4344-b9f7-a80eeee96ba2"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:26:16.849154 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-5e49244d-6482-4965-98e0-f06f8dec9739 req-1d1c697b-ab65-4dc3-a154-94cc5b34dca6 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:26:16.850281 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-5e49244d-6482-4965-98e0-f06f8dec9739 req-1d1c697b-ab65-4dc3-a154-94cc5b34dca6 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:26:16.851352 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-5e49244d-6482-4965-98e0-f06f8dec9739 req-1d1c697b-ab65-4dc3-a154-94cc5b34dca6 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:26:16.876708 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-5e49244d-6482-4965-98e0-f06f8dec9739 req-1d1c697b-ab65-4dc3-a154-94cc5b34dca6 service nova] Creating event network-changed:75f99f30-6170-4344-b9f7-a80eeee96ba2 for instance 9685ccea-9ac8-4b1b-9311-2b67570eed43 on hv-cinder-85694 Sep 13 01:26:16.884621 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-5e49244d-6482-4965-98e0-f06f8dec9739 req-1d1c697b-ab65-4dc3-a154-94cc5b34dca6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077207 Sep 13 01:26:16.885906 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 475/954] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:27:39.222369 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR oslo.messaging._drivers.impl_rabbit [-] [049bc8e7-9ab6-4aa7-9298-faa4fc78da32] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 13 01:27:39.224217 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=15 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:39.225536 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=59 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:39.230645 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3c195d9b-6971-43fa-8ef3-09f54b2ec8b4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Action: 'create', calling method: .version_select at 0x7fb061cd0c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1368361343", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKrifKMPatYnoxzHKIdIZfGtKp/juX5Wd6JcjsEpGSuo20gfrmjAUGQ0pgu0/hZzbIGTetPaQ0yacOpCxiDn3+KhLb5BvvqlCLqCJpzgAZGNW3EVAY399v7OKNzTH5DjZg=="}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:27:39.246420 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-3c195d9b-6971-43fa-8ef3-09f54b2ec8b4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Getting quotas for project 7bede684fde243038bcb6b0d5c31ac8f. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:27:39.250184 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-3c195d9b-6971-43fa-8ef3-09f54b2ec8b4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Getting quotas for user d54805410115495597ef0720af2acf22 and project 7bede684fde243038bcb6b0d5c31ac8f. Resources: {'key_pairs'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:27:39.271788 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3c195d9b-6971-43fa-8ef3-09f54b2ec8b4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.051090 Sep 13 01:27:39.272410 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 480/955] 10.222.0.15 () {60 vars in 1159 bytes} [Tue Sep 13 01:27:39 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:27:39.321354 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=15 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:39.322097 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=43 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:39.323473 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 13 01:27:39.323650 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Tue Sep 13 01:27:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.15) !!! Sep 13 01:27:39.325715 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 13 01:27:39.334622 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-151526456", "imageRef": "ae43166b-80ef-467d-9e0c-c43a18eea469", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1368361343", "networks": [{"uuid": "73d26f60-fc5a-4796-a2af-224032b1760c"}]}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:27:39.390533 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.network.neutron [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] validate_networks() for [('73d26f60-fc5a-4796-a2af-224032b1760c', None, None, None, None, None)] {{(pid=120412) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:27:39.765073 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Flavor limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:27:39.765502 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Image limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:27:39.765979 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Flavor pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:27:39.767030 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Image pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:27:39.767441 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:27:39.777177 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:39.777597 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:39.778045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:39.778724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:39.779210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:39.779635 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:39.796898 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Getting quotas for project 7bede684fde243038bcb6b0d5c31ac8f. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:27:39.800811 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Getting quotas for user d54805410115495597ef0720af2acf22 and project 7bede684fde243038bcb6b0d5c31ac8f. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:27:39.812217 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Going to run 1 instances... {{(pid=120412) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:27:39.814552 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='ae43166b-80ef-467d-9e0c-c43a18eea469',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120412) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:27:39.861022 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-2efeb216-a2c1-4c90-92cc-ce82c39280dc tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541729 Sep 13 01:27:39.861676 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 476/956] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:27:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 13 01:27:39.872581 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1dc061fb-ebc9-47b9-af18-d321967105b2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:39.873196 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1dc061fb-ebc9-47b9-af18-d321967105b2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:39.927142 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1dc061fb-ebc9-47b9-af18-d321967105b2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:39.935979 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1dc061fb-ebc9-47b9-af18-d321967105b2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1258 microversion: 2.1 time: 0.067167 Sep 13 01:27:39.936635 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 481/957] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:39 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:40.961499 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c2483db4-4823-4f05-8084-3daa6e8b8575 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:40.962096 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c2483db4-4823-4f05-8084-3daa6e8b8575 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:40.969369 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2483db4-4823-4f05-8084-3daa6e8b8575 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:40.969868 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2483db4-4823-4f05-8084-3daa6e8b8575 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:40.970307 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2483db4-4823-4f05-8084-3daa6e8b8575 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:40.971658 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2483db4-4823-4f05-8084-3daa6e8b8575 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:40.972132 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2483db4-4823-4f05-8084-3daa6e8b8575 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:40.972578 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c2483db4-4823-4f05-8084-3daa6e8b8575 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:41.046078 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c2483db4-4823-4f05-8084-3daa6e8b8575 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:41.054207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c2483db4-4823-4f05-8084-3daa6e8b8575 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1318 microversion: 2.1 time: 0.098044 Sep 13 01:27:41.054786 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 477/958] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:40 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1318 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:42.076908 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bf30ba1a-9509-4e29-8005-9f05b02cb9c4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:42.077525 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bf30ba1a-9509-4e29-8005-9f05b02cb9c4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:42.090655 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf30ba1a-9509-4e29-8005-9f05b02cb9c4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:42.091353 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf30ba1a-9509-4e29-8005-9f05b02cb9c4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:42.096213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf30ba1a-9509-4e29-8005-9f05b02cb9c4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:42.097319 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf30ba1a-9509-4e29-8005-9f05b02cb9c4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:42.097803 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf30ba1a-9509-4e29-8005-9f05b02cb9c4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:42.098243 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bf30ba1a-9509-4e29-8005-9f05b02cb9c4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:42.107797 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO oslo.messaging._drivers.impl_rabbit [-] [049bc8e7-9ab6-4aa7-9298-faa4fc78da32] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 57568. Sep 13 01:27:42.270286 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bf30ba1a-9509-4e29-8005-9f05b02cb9c4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:42.285798 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bf30ba1a-9509-4e29-8005-9f05b02cb9c4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1358 microversion: 2.1 time: 0.212739 Sep 13 01:27:42.286394 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 482/959] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:42 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:43.312470 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-18a28d15-f7e5-481b-a462-1061ccaf1e84 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:43.313084 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-18a28d15-f7e5-481b-a462-1061ccaf1e84 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:43.321805 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-18a28d15-f7e5-481b-a462-1061ccaf1e84 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:43.322294 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-18a28d15-f7e5-481b-a462-1061ccaf1e84 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:43.322729 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-18a28d15-f7e5-481b-a462-1061ccaf1e84 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:43.323461 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-18a28d15-f7e5-481b-a462-1061ccaf1e84 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:43.328969 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-18a28d15-f7e5-481b-a462-1061ccaf1e84 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:43.329644 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-18a28d15-f7e5-481b-a462-1061ccaf1e84 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:43.512154 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-18a28d15-f7e5-481b-a462-1061ccaf1e84 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:43.520403 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-18a28d15-f7e5-481b-a462-1061ccaf1e84 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1358 microversion: 2.1 time: 0.211765 Sep 13 01:27:43.521015 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 478/960] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:43 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1358 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:44.544105 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-63b501ad-5f5e-4b89-a8b5-747607bc37b0 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:44.545524 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-63b501ad-5f5e-4b89-a8b5-747607bc37b0 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:44.552156 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-63b501ad-5f5e-4b89-a8b5-747607bc37b0 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:44.553220 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-63b501ad-5f5e-4b89-a8b5-747607bc37b0 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:44.554076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-63b501ad-5f5e-4b89-a8b5-747607bc37b0 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:44.555026 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-63b501ad-5f5e-4b89-a8b5-747607bc37b0 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:44.555681 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-63b501ad-5f5e-4b89-a8b5-747607bc37b0 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:44.556332 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-63b501ad-5f5e-4b89-a8b5-747607bc37b0 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:44.908499 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-63b501ad-5f5e-4b89-a8b5-747607bc37b0 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:44.923701 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-63b501ad-5f5e-4b89-a8b5-747607bc37b0 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1358 microversion: 2.1 time: 0.383415 Sep 13 01:27:44.924275 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 483/961] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:44 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1358 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:45.950736 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b0168832-92eb-40ab-a759-398e510263db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:45.951682 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b0168832-92eb-40ab-a759-398e510263db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:45.958561 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0168832-92eb-40ab-a759-398e510263db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:45.959081 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0168832-92eb-40ab-a759-398e510263db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:45.959523 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0168832-92eb-40ab-a759-398e510263db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:45.960229 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0168832-92eb-40ab-a759-398e510263db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:45.960684 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0168832-92eb-40ab-a759-398e510263db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:45.961114 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-b0168832-92eb-40ab-a759-398e510263db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:46.120346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-397220517", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "networks": [{"uuid": "77dfb21b-3abb-4934-9b61-126b168eaef7"}]}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:27:46.122582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b0168832-92eb-40ab-a759-398e510263db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:46.131004 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b0168832-92eb-40ab-a759-398e510263db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1358 microversion: 2.1 time: 0.184328 Sep 13 01:27:46.131521 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 479/962] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:45 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1358 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:46.199033 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.network.neutron [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] validate_networks() for [('77dfb21b-3abb-4934-9b61-126b168eaef7', None, None, None, None, None)] {{(pid=120415) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:27:46.581565 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Flavor limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:27:46.581982 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Image limits 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:27:46.582448 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Flavor pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:27:46.582874 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Image pref 0:0:0 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:27:46.583278 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.virt.hardware [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120415) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:27:46.592348 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:46.592831 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:46.593258 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:46.593983 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:46.594430 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:46.594847 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:46.612334 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Getting quotas for project 53b74c0569e9452d817797f3f9d3a78f. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:27:46.617123 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.quota [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Getting quotas for user ed67fb86412a404d9acd882d88432b8c and project 53b74c0569e9452d817797f3f9d3a78f. Resources: {'instances', 'ram', 'cores'} {{(pid=120415) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:27:46.630423 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Going to run 1 instances... {{(pid=120415) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:27:46.633481 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120415) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:27:46.684332 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ffdfea4d-30eb-408d-8760-47246cc28851 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.567867 Sep 13 01:27:46.685325 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 484/963] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:27:46 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 01:27:46.696007 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-b73a240d-f284-46af-b3f7-9799eb209dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:46.696956 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-b73a240d-f284-46af-b3f7-9799eb209dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:46.766833 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-b73a240d-f284-46af-b3f7-9799eb209dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:46.775012 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-b73a240d-f284-46af-b3f7-9799eb209dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1218 microversion: 2.1 time: 0.082784 Sep 13 01:27:46.775920 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 480/964] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:46 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:27:47.154610 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-65b0b5ef-44d9-47ac-96f4-f4e642cbb83e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:47.155392 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-65b0b5ef-44d9-47ac-96f4-f4e642cbb83e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:47.163024 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-65b0b5ef-44d9-47ac-96f4-f4e642cbb83e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:47.163739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-65b0b5ef-44d9-47ac-96f4-f4e642cbb83e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:47.164351 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-65b0b5ef-44d9-47ac-96f4-f4e642cbb83e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:47.165310 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-65b0b5ef-44d9-47ac-96f4-f4e642cbb83e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:47.165981 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-65b0b5ef-44d9-47ac-96f4-f4e642cbb83e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:47.166681 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-65b0b5ef-44d9-47ac-96f4-f4e642cbb83e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:47.314789 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-65b0b5ef-44d9-47ac-96f4-f4e642cbb83e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:47.323280 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-65b0b5ef-44d9-47ac-96f4-f4e642cbb83e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1358 microversion: 2.1 time: 0.173502 Sep 13 01:27:47.323847 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 485/965] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:47 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:47.797825 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f8697748-2a0b-4add-9271-a3de6d6dac5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:47.798679 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-f8697748-2a0b-4add-9271-a3de6d6dac5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:47.806479 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f8697748-2a0b-4add-9271-a3de6d6dac5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:47.806994 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f8697748-2a0b-4add-9271-a3de6d6dac5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:47.807428 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f8697748-2a0b-4add-9271-a3de6d6dac5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:47.808125 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f8697748-2a0b-4add-9271-a3de6d6dac5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:47.808571 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f8697748-2a0b-4add-9271-a3de6d6dac5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:47.808987 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f8697748-2a0b-4add-9271-a3de6d6dac5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:47.871944 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f8697748-2a0b-4add-9271-a3de6d6dac5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:47.880803 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f8697748-2a0b-4add-9271-a3de6d6dac5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1222 microversion: 2.1 time: 0.086844 Sep 13 01:27:47.881706 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 481/966] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:47 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:48.349809 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8240d93c-6342-4e6f-9164-986e0ddbd0d2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:48.350538 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8240d93c-6342-4e6f-9164-986e0ddbd0d2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:48.357319 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8240d93c-6342-4e6f-9164-986e0ddbd0d2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:48.357807 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8240d93c-6342-4e6f-9164-986e0ddbd0d2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:48.358233 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8240d93c-6342-4e6f-9164-986e0ddbd0d2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:48.358951 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8240d93c-6342-4e6f-9164-986e0ddbd0d2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:48.359400 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8240d93c-6342-4e6f-9164-986e0ddbd0d2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:48.359819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8240d93c-6342-4e6f-9164-986e0ddbd0d2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:48.500923 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-8240d93c-6342-4e6f-9164-986e0ddbd0d2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:48.509263 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8240d93c-6342-4e6f-9164-986e0ddbd0d2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1358 microversion: 2.1 time: 0.165581 Sep 13 01:27:48.509826 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 486/967] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:48 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:48.903889 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5600e027-76f9-41c5-b0a1-34b05340c2a0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:48.904486 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-5600e027-76f9-41c5-b0a1-34b05340c2a0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:48.910877 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5600e027-76f9-41c5-b0a1-34b05340c2a0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:48.911991 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5600e027-76f9-41c5-b0a1-34b05340c2a0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:48.912430 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5600e027-76f9-41c5-b0a1-34b05340c2a0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:48.913124 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5600e027-76f9-41c5-b0a1-34b05340c2a0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:48.913577 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5600e027-76f9-41c5-b0a1-34b05340c2a0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:48.914000 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5600e027-76f9-41c5-b0a1-34b05340c2a0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:48.975508 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5600e027-76f9-41c5-b0a1-34b05340c2a0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:48.983394 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-5600e027-76f9-41c5-b0a1-34b05340c2a0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1222 microversion: 2.1 time: 0.083451 Sep 13 01:27:48.984151 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 482/968] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:48 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:49.537792 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c8af342e-3218-436a-9e9f-c3ed63f6336a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:49.538402 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c8af342e-3218-436a-9e9f-c3ed63f6336a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:49.544974 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8af342e-3218-436a-9e9f-c3ed63f6336a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:49.545338 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8af342e-3218-436a-9e9f-c3ed63f6336a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:49.545774 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8af342e-3218-436a-9e9f-c3ed63f6336a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:49.546463 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8af342e-3218-436a-9e9f-c3ed63f6336a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:49.546938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8af342e-3218-436a-9e9f-c3ed63f6336a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:49.547362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c8af342e-3218-436a-9e9f-c3ed63f6336a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:49.695189 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c8af342e-3218-436a-9e9f-c3ed63f6336a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:49.702971 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c8af342e-3218-436a-9e9f-c3ed63f6336a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1358 microversion: 2.1 time: 0.169487 Sep 13 01:27:49.703766 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 487/969] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:49 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:50.006265 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-39519f23-b2b8-4680-9315-0c1697d03904 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:50.006929 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-39519f23-b2b8-4680-9315-0c1697d03904 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:50.009837 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:50.015085 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-39519f23-b2b8-4680-9315-0c1697d03904 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:50.015581 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-39519f23-b2b8-4680-9315-0c1697d03904 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:50.016018 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-39519f23-b2b8-4680-9315-0c1697d03904 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:50.016914 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-39519f23-b2b8-4680-9315-0c1697d03904 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:50.017371 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-39519f23-b2b8-4680-9315-0c1697d03904 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:50.017795 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-39519f23-b2b8-4680-9315-0c1697d03904 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:50.095639 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-39519f23-b2b8-4680-9315-0c1697d03904 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:50.103947 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-39519f23-b2b8-4680-9315-0c1697d03904 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1214 microversion: 2.1 time: 0.102332 Sep 13 01:27:50.104519 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 483/970] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:50 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1214 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:50.274937 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-eaa45351-c569-479c-91df-b4abdfff0dea req-f4523184-3939-4dc6-b057-1a927bfe2b7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d2d899-2749-4525-a1c3-a96617c5d619", "tag": "1012c39b-1d73-4b31-9a78-4519d95f4972"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:27:50.285813 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-eaa45351-c569-479c-91df-b4abdfff0dea req-f4523184-3939-4dc6-b057-1a927bfe2b7c service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:50.286946 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-eaa45351-c569-479c-91df-b4abdfff0dea req-f4523184-3939-4dc6-b057-1a927bfe2b7c service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:50.287452 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-eaa45351-c569-479c-91df-b4abdfff0dea req-f4523184-3939-4dc6-b057-1a927bfe2b7c service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:50.299076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-eaa45351-c569-479c-91df-b4abdfff0dea req-f4523184-3939-4dc6-b057-1a927bfe2b7c service nova] Creating event network-changed:1012c39b-1d73-4b31-9a78-4519d95f4972 for instance 09d2d899-2749-4525-a1c3-a96617c5d619 on hv-cinder-85694 Sep 13 01:27:50.305729 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-eaa45351-c569-479c-91df-b4abdfff0dea req-f4523184-3939-4dc6-b057-1a927bfe2b7c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034538 Sep 13 01:27:50.306398 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 488/971] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:27:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:27:50.728149 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d0dff367-76c6-4336-8432-8e62a6d804aa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:50.728846 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d0dff367-76c6-4336-8432-8e62a6d804aa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:50.735086 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d0dff367-76c6-4336-8432-8e62a6d804aa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:50.735945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d0dff367-76c6-4336-8432-8e62a6d804aa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:50.736453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d0dff367-76c6-4336-8432-8e62a6d804aa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:50.737798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d0dff367-76c6-4336-8432-8e62a6d804aa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:50.738289 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d0dff367-76c6-4336-8432-8e62a6d804aa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:50.738755 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d0dff367-76c6-4336-8432-8e62a6d804aa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:51.130559 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-edfbcc71-7c5d-4d58-a511-a1dd54f0fc9f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:51.131454 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-edfbcc71-7c5d-4d58-a511-a1dd54f0fc9f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:51.138347 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-edfbcc71-7c5d-4d58-a511-a1dd54f0fc9f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:51.139175 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-edfbcc71-7c5d-4d58-a511-a1dd54f0fc9f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:51.140081 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-edfbcc71-7c5d-4d58-a511-a1dd54f0fc9f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:51.141265 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-edfbcc71-7c5d-4d58-a511-a1dd54f0fc9f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:51.141790 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-edfbcc71-7c5d-4d58-a511-a1dd54f0fc9f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:51.142384 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-edfbcc71-7c5d-4d58-a511-a1dd54f0fc9f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:51.213869 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-edfbcc71-7c5d-4d58-a511-a1dd54f0fc9f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:51.222542 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-edfbcc71-7c5d-4d58-a511-a1dd54f0fc9f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1278 microversion: 2.1 time: 0.097986 Sep 13 01:27:51.223148 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 489/972] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:51 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:51.251466 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d0dff367-76c6-4336-8432-8e62a6d804aa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:51.261615 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d0dff367-76c6-4336-8432-8e62a6d804aa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1358 microversion: 2.1 time: 0.538793 Sep 13 01:27:51.262466 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 484/973] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:50 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1358 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:52.246352 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d0181768-878e-461f-a544-54094f7700ec tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:52.247002 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d0181768-878e-461f-a544-54094f7700ec tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:52.253642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0181768-878e-461f-a544-54094f7700ec tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:52.254154 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0181768-878e-461f-a544-54094f7700ec tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:52.254576 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0181768-878e-461f-a544-54094f7700ec tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:52.256025 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0181768-878e-461f-a544-54094f7700ec tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:52.256405 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0181768-878e-461f-a544-54094f7700ec tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:52.256908 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d0181768-878e-461f-a544-54094f7700ec tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:52.284496 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-947792af-8036-4509-b053-47f097f8a5eb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:52.285097 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-947792af-8036-4509-b053-47f097f8a5eb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:52.292271 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-947792af-8036-4509-b053-47f097f8a5eb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:52.292773 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-947792af-8036-4509-b053-47f097f8a5eb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:52.293216 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-947792af-8036-4509-b053-47f097f8a5eb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:52.293924 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-947792af-8036-4509-b053-47f097f8a5eb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:52.294417 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-947792af-8036-4509-b053-47f097f8a5eb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:52.294846 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-947792af-8036-4509-b053-47f097f8a5eb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:52.393192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d0181768-878e-461f-a544-54094f7700ec tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:52.400862 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d0181768-878e-461f-a544-54094f7700ec tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1318 microversion: 2.1 time: 0.158458 Sep 13 01:27:52.401671 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 490/974] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:52 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:52.713487 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-947792af-8036-4509-b053-47f097f8a5eb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:52.721639 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-947792af-8036-4509-b053-47f097f8a5eb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1358 microversion: 2.1 time: 0.441055 Sep 13 01:27:52.722221 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 485/975] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:52 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1358 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:27:53.423569 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-18173896-77cc-484a-a360-9d4eaf32ec50 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:53.424331 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-18173896-77cc-484a-a360-9d4eaf32ec50 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:53.431382 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18173896-77cc-484a-a360-9d4eaf32ec50 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:53.431866 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18173896-77cc-484a-a360-9d4eaf32ec50 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:53.432294 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18173896-77cc-484a-a360-9d4eaf32ec50 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:53.432994 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18173896-77cc-484a-a360-9d4eaf32ec50 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:53.433439 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18173896-77cc-484a-a360-9d4eaf32ec50 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:53.433854 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-18173896-77cc-484a-a360-9d4eaf32ec50 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:53.565150 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-18173896-77cc-484a-a360-9d4eaf32ec50 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:53.573325 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-18173896-77cc-484a-a360-9d4eaf32ec50 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1318 microversion: 2.1 time: 0.153686 Sep 13 01:27:53.574011 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 491/976] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:53 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:53.745382 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-4d13416e-8bc9-4127-8bc3-c8597b9eb41c req-b63382ef-ae44-4c3b-aa81-2597ef69a8da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bbdde643-e612-4f6f-8f73-28e8a20a6236", "tag": "9be82c92-faec-427b-aa31-918c40122fd1"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:27:53.755533 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-56ea50ef-07ef-4bf7-968a-7bb360cfeb06 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:53.756192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-56ea50ef-07ef-4bf7-968a-7bb360cfeb06 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:53.760067 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-4d13416e-8bc9-4127-8bc3-c8597b9eb41c req-b63382ef-ae44-4c3b-aa81-2597ef69a8da service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:53.760797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-4d13416e-8bc9-4127-8bc3-c8597b9eb41c req-b63382ef-ae44-4c3b-aa81-2597ef69a8da service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:53.761224 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-4d13416e-8bc9-4127-8bc3-c8597b9eb41c req-b63382ef-ae44-4c3b-aa81-2597ef69a8da service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:53.769701 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56ea50ef-07ef-4bf7-968a-7bb360cfeb06 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:53.770196 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56ea50ef-07ef-4bf7-968a-7bb360cfeb06 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:53.773068 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-4d13416e-8bc9-4127-8bc3-c8597b9eb41c req-b63382ef-ae44-4c3b-aa81-2597ef69a8da service nova] Creating event network-changed:9be82c92-faec-427b-aa31-918c40122fd1 for instance bbdde643-e612-4f6f-8f73-28e8a20a6236 on hv-cinder-85694 Sep 13 01:27:53.773329 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56ea50ef-07ef-4bf7-968a-7bb360cfeb06 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:53.774141 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56ea50ef-07ef-4bf7-968a-7bb360cfeb06 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:53.774830 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56ea50ef-07ef-4bf7-968a-7bb360cfeb06 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:53.775450 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-56ea50ef-07ef-4bf7-968a-7bb360cfeb06 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:53.778798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-4d13416e-8bc9-4127-8bc3-c8597b9eb41c req-b63382ef-ae44-4c3b-aa81-2597ef69a8da service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037685 Sep 13 01:27:53.779414 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 486/977] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:27:53.909371 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-56ea50ef-07ef-4bf7-968a-7bb360cfeb06 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:53.917633 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-56ea50ef-07ef-4bf7-968a-7bb360cfeb06 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1358 microversion: 2.1 time: 0.173703 Sep 13 01:27:53.918202 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 492/978] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:53 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:54.596390 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-46058851-43c0-419f-bcb7-1cd9403cbd47 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:54.597028 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-46058851-43c0-419f-bcb7-1cd9403cbd47 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:54.603155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46058851-43c0-419f-bcb7-1cd9403cbd47 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:54.603643 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46058851-43c0-419f-bcb7-1cd9403cbd47 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:54.604079 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46058851-43c0-419f-bcb7-1cd9403cbd47 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:54.604765 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46058851-43c0-419f-bcb7-1cd9403cbd47 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:54.605217 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46058851-43c0-419f-bcb7-1cd9403cbd47 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:54.605640 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-46058851-43c0-419f-bcb7-1cd9403cbd47 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:54.734943 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-46058851-43c0-419f-bcb7-1cd9403cbd47 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:54.742554 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-46058851-43c0-419f-bcb7-1cd9403cbd47 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1318 microversion: 2.1 time: 0.150399 Sep 13 01:27:54.743152 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 487/979] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:54 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:54.941025 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e0629c7b-d8bf-458d-b84f-bed0c3101fb9 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:54.941729 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e0629c7b-d8bf-458d-b84f-bed0c3101fb9 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:54.948756 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0629c7b-d8bf-458d-b84f-bed0c3101fb9 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:54.949231 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0629c7b-d8bf-458d-b84f-bed0c3101fb9 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:54.949664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0629c7b-d8bf-458d-b84f-bed0c3101fb9 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:54.950355 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0629c7b-d8bf-458d-b84f-bed0c3101fb9 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:54.950799 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0629c7b-d8bf-458d-b84f-bed0c3101fb9 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:54.951246 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0629c7b-d8bf-458d-b84f-bed0c3101fb9 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:55.078392 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e0629c7b-d8bf-458d-b84f-bed0c3101fb9 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:55.086141 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e0629c7b-d8bf-458d-b84f-bed0c3101fb9 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1358 microversion: 2.1 time: 0.149011 Sep 13 01:27:55.086701 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 493/980] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:54 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:55.765278 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-35bca4a9-1bc6-4464-8b3b-b7151685858d tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:55.765899 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-35bca4a9-1bc6-4464-8b3b-b7151685858d tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:55.772808 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-35bca4a9-1bc6-4464-8b3b-b7151685858d tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:55.773304 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-35bca4a9-1bc6-4464-8b3b-b7151685858d tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:55.773749 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-35bca4a9-1bc6-4464-8b3b-b7151685858d tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:55.774457 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-35bca4a9-1bc6-4464-8b3b-b7151685858d tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:55.774949 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-35bca4a9-1bc6-4464-8b3b-b7151685858d tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:55.775385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-35bca4a9-1bc6-4464-8b3b-b7151685858d tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:55.902266 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-35bca4a9-1bc6-4464-8b3b-b7151685858d tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:55.909871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-35bca4a9-1bc6-4464-8b3b-b7151685858d tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1318 microversion: 2.1 time: 0.148457 Sep 13 01:27:55.910439 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 488/981] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:55 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:56.108391 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c1fadbc1-2b8f-4028-8370-c5caecf856bb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:56.109009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c1fadbc1-2b8f-4028-8370-c5caecf856bb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:56.115344 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c1fadbc1-2b8f-4028-8370-c5caecf856bb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:56.115829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c1fadbc1-2b8f-4028-8370-c5caecf856bb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:56.116272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c1fadbc1-2b8f-4028-8370-c5caecf856bb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:56.116961 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c1fadbc1-2b8f-4028-8370-c5caecf856bb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:56.117416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c1fadbc1-2b8f-4028-8370-c5caecf856bb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:56.117842 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c1fadbc1-2b8f-4028-8370-c5caecf856bb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:56.242846 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c1fadbc1-2b8f-4028-8370-c5caecf856bb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:56.250465 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c1fadbc1-2b8f-4028-8370-c5caecf856bb tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1358 microversion: 2.1 time: 0.145875 Sep 13 01:27:56.251054 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 494/982] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:56 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1358 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:56.594844 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-a97553e4-00fd-4729-b01c-ab1201a27f49 req-8c8798aa-1a5b-4a99-b287-fed8ebef67e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d2d899-2749-4525-a1c3-a96617c5d619", "name": "network-vif-plugged", "status": "completed", "tag": "1012c39b-1d73-4b31-9a78-4519d95f4972"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:27:56.604996 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-a97553e4-00fd-4729-b01c-ab1201a27f49 req-8c8798aa-1a5b-4a99-b287-fed8ebef67e2 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:56.605610 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-a97553e4-00fd-4729-b01c-ab1201a27f49 req-8c8798aa-1a5b-4a99-b287-fed8ebef67e2 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:56.605902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-a97553e4-00fd-4729-b01c-ab1201a27f49 req-8c8798aa-1a5b-4a99-b287-fed8ebef67e2 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:56.617264 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-a97553e4-00fd-4729-b01c-ab1201a27f49 req-8c8798aa-1a5b-4a99-b287-fed8ebef67e2 service nova] Creating event network-vif-plugged:1012c39b-1d73-4b31-9a78-4519d95f4972 for instance 09d2d899-2749-4525-a1c3-a96617c5d619 on hv-cinder-85694 Sep 13 01:27:56.622011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-a97553e4-00fd-4729-b01c-ab1201a27f49 req-8c8798aa-1a5b-4a99-b287-fed8ebef67e2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030913 Sep 13 01:27:56.622782 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 489/983] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:27:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:27:56.933395 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0bcb8b17-a97d-4aeb-b644-7cc894aa7ca4 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:56.933992 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0bcb8b17-a97d-4aeb-b644-7cc894aa7ca4 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:56.936128 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:56.936861 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=12 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:56.943350 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0bcb8b17-a97d-4aeb-b644-7cc894aa7ca4 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:56.943924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0bcb8b17-a97d-4aeb-b644-7cc894aa7ca4 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:56.944362 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0bcb8b17-a97d-4aeb-b644-7cc894aa7ca4 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:56.945070 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0bcb8b17-a97d-4aeb-b644-7cc894aa7ca4 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:56.945517 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0bcb8b17-a97d-4aeb-b644-7cc894aa7ca4 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:56.945932 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0bcb8b17-a97d-4aeb-b644-7cc894aa7ca4 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:57.081750 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-0bcb8b17-a97d-4aeb-b644-7cc894aa7ca4 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:57.092062 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0bcb8b17-a97d-4aeb-b644-7cc894aa7ca4 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1318 microversion: 2.1 time: 0.162600 Sep 13 01:27:57.092814 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 495/984] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:56 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:57.270233 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=8 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:27:57.274512 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0bd42187-8ecc-45f5-acfb-cc561a6b4fc1 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:57.275251 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0bd42187-8ecc-45f5-acfb-cc561a6b4fc1 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:57.281628 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bd42187-8ecc-45f5-acfb-cc561a6b4fc1 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:57.282106 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bd42187-8ecc-45f5-acfb-cc561a6b4fc1 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:57.282535 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bd42187-8ecc-45f5-acfb-cc561a6b4fc1 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:57.283252 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bd42187-8ecc-45f5-acfb-cc561a6b4fc1 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:57.283702 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bd42187-8ecc-45f5-acfb-cc561a6b4fc1 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:57.284115 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0bd42187-8ecc-45f5-acfb-cc561a6b4fc1 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:57.419477 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0bd42187-8ecc-45f5-acfb-cc561a6b4fc1 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:57.427098 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0bd42187-8ecc-45f5-acfb-cc561a6b4fc1 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1358 microversion: 2.1 time: 0.158265 Sep 13 01:27:57.427913 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 490/985] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:57 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:58.115787 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-4572fae5-a7d3-477b-97a4-526131fac9c0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:58.116396 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-4572fae5-a7d3-477b-97a4-526131fac9c0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:58.122513 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4572fae5-a7d3-477b-97a4-526131fac9c0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:58.123368 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4572fae5-a7d3-477b-97a4-526131fac9c0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:58.123806 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4572fae5-a7d3-477b-97a4-526131fac9c0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:58.124500 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4572fae5-a7d3-477b-97a4-526131fac9c0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:58.124946 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4572fae5-a7d3-477b-97a4-526131fac9c0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:58.125627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-4572fae5-a7d3-477b-97a4-526131fac9c0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:58.255941 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-4572fae5-a7d3-477b-97a4-526131fac9c0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:58.264237 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-4572fae5-a7d3-477b-97a4-526131fac9c0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1318 microversion: 2.1 time: 0.152667 Sep 13 01:27:58.264811 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 496/986] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:58 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:58.449734 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7602bbcf-375c-4a7c-a664-d95a65b5991d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:58.450353 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7602bbcf-375c-4a7c-a664-d95a65b5991d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:58.456984 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7602bbcf-375c-4a7c-a664-d95a65b5991d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:58.457781 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7602bbcf-375c-4a7c-a664-d95a65b5991d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:58.458040 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7602bbcf-375c-4a7c-a664-d95a65b5991d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:58.458584 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7602bbcf-375c-4a7c-a664-d95a65b5991d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:58.459051 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7602bbcf-375c-4a7c-a664-d95a65b5991d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:58.459477 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7602bbcf-375c-4a7c-a664-d95a65b5991d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:58.590233 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7602bbcf-375c-4a7c-a664-d95a65b5991d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:58.597851 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7602bbcf-375c-4a7c-a664-d95a65b5991d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1549 microversion: 2.1 time: 0.152041 Sep 13 01:27:58.598933 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 491/987] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:58 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1549 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:58.620472 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1a7ba12f-5aa7-4507-bc1b-006cf935ff2c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:58.621079 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1a7ba12f-5aa7-4507-bc1b-006cf935ff2c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:58.627071 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a7ba12f-5aa7-4507-bc1b-006cf935ff2c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:58.627557 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a7ba12f-5aa7-4507-bc1b-006cf935ff2c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:58.627978 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a7ba12f-5aa7-4507-bc1b-006cf935ff2c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:58.628660 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a7ba12f-5aa7-4507-bc1b-006cf935ff2c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:58.629105 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a7ba12f-5aa7-4507-bc1b-006cf935ff2c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:58.629579 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1a7ba12f-5aa7-4507-bc1b-006cf935ff2c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:58.636757 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-40e892d3-b162-4789-9e82-55a2a969adf6 req-7342d99f-2067-490c-a3e9-64140bd9404a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbdde643-e612-4f6f-8f73-28e8a20a6236", "name": "network-vif-plugged", "status": "completed", "tag": "9be82c92-faec-427b-aa31-918c40122fd1"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:27:58.646705 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-40e892d3-b162-4789-9e82-55a2a969adf6 req-7342d99f-2067-490c-a3e9-64140bd9404a service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:58.647209 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-40e892d3-b162-4789-9e82-55a2a969adf6 req-7342d99f-2067-490c-a3e9-64140bd9404a service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:58.647642 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-40e892d3-b162-4789-9e82-55a2a969adf6 req-7342d99f-2067-490c-a3e9-64140bd9404a service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:58.658097 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-40e892d3-b162-4789-9e82-55a2a969adf6 req-7342d99f-2067-490c-a3e9-64140bd9404a service nova] Creating event network-vif-plugged:9be82c92-faec-427b-aa31-918c40122fd1 for instance bbdde643-e612-4f6f-8f73-28e8a20a6236 on hv-cinder-85694 Sep 13 01:27:58.663547 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-40e892d3-b162-4789-9e82-55a2a969adf6 req-7342d99f-2067-490c-a3e9-64140bd9404a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030265 Sep 13 01:27:58.664071 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 492/988] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:27:58.761612 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1a7ba12f-5aa7-4507-bc1b-006cf935ff2c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:58.770056 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1a7ba12f-5aa7-4507-bc1b-006cf935ff2c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1549 microversion: 2.1 time: 0.153283 Sep 13 01:27:58.771182 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 497/989] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:58 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1549 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:58.792572 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-90998fad-ef68-41e0-b774-f9ae74b520e5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:58.797386 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-90998fad-ef68-41e0-b774-f9ae74b520e5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:58.798135 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-90998fad-ef68-41e0-b774-f9ae74b520e5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Searching by: {'deleted': False, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f'} {{(pid=120412) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 13 01:27:58.805619 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-90998fad-ef68-41e0-b774-f9ae74b520e5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:58.806111 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-90998fad-ef68-41e0-b774-f9ae74b520e5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:58.806541 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-90998fad-ef68-41e0-b774-f9ae74b520e5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:58.807473 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-90998fad-ef68-41e0-b774-f9ae74b520e5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:58.807928 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-90998fad-ef68-41e0-b774-f9ae74b520e5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:58.808560 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-90998fad-ef68-41e0-b774-f9ae74b520e5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:58.897722 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.multi_cell_list [None req-90998fad-ef68-41e0-b774-f9ae74b520e5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120412) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 13 01:27:58.992913 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-90998fad-ef68-41e0-b774-f9ae74b520e5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.204442 Sep 13 01:27:58.993494 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 493/990] 10.222.0.15 () {58 vars in 1125 bytes} [Tue Sep 13 01:27:58 2022] GET /compute/v2.1/servers => generated 342 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:27:59.005497 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6f7ae96e-9e07-49d3-9ef2-10563894be96 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:59.006103 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6f7ae96e-9e07-49d3-9ef2-10563894be96 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:59.012004 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f7ae96e-9e07-49d3-9ef2-10563894be96 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:59.012481 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f7ae96e-9e07-49d3-9ef2-10563894be96 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:59.012912 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f7ae96e-9e07-49d3-9ef2-10563894be96 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:59.013594 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f7ae96e-9e07-49d3-9ef2-10563894be96 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:59.014043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f7ae96e-9e07-49d3-9ef2-10563894be96 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:59.014460 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6f7ae96e-9e07-49d3-9ef2-10563894be96 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:59.138290 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6f7ae96e-9e07-49d3-9ef2-10563894be96 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:59.145939 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6f7ae96e-9e07-49d3-9ef2-10563894be96 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1549 microversion: 2.1 time: 0.144895 Sep 13 01:27:59.146501 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 498/991] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:58 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1549 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:27:59.287992 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-736dc8a1-e36e-4ff4-b38d-f72934466f77 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:27:59.288650 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-736dc8a1-e36e-4ff4-b38d-f72934466f77 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:27:59.295057 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-736dc8a1-e36e-4ff4-b38d-f72934466f77 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:59.295696 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-736dc8a1-e36e-4ff4-b38d-f72934466f77 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:59.296139 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-736dc8a1-e36e-4ff4-b38d-f72934466f77 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:59.296845 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-736dc8a1-e36e-4ff4-b38d-f72934466f77 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:27:59.297301 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-736dc8a1-e36e-4ff4-b38d-f72934466f77 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:27:59.297724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-736dc8a1-e36e-4ff4-b38d-f72934466f77 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:27:59.455106 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-736dc8a1-e36e-4ff4-b38d-f72934466f77 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:27:59.455106 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-736dc8a1-e36e-4ff4-b38d-f72934466f77 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1318 microversion: 2.1 time: 0.167898 Sep 13 01:27:59.455106 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 494/992] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:27:59 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:00.477840 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-16d5f012-0663-49ff-b488-1b19286bbc67 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:00.478450 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-16d5f012-0663-49ff-b488-1b19286bbc67 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:00.486595 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-16d5f012-0663-49ff-b488-1b19286bbc67 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:00.487507 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-16d5f012-0663-49ff-b488-1b19286bbc67 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:00.488310 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-16d5f012-0663-49ff-b488-1b19286bbc67 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:00.489941 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-16d5f012-0663-49ff-b488-1b19286bbc67 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:00.490429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-16d5f012-0663-49ff-b488-1b19286bbc67 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:00.490987 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-16d5f012-0663-49ff-b488-1b19286bbc67 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:00.632440 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-16d5f012-0663-49ff-b488-1b19286bbc67 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:00.635950 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=100 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:00.640619 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-16d5f012-0663-49ff-b488-1b19286bbc67 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1507 microversion: 2.1 time: 0.166580 Sep 13 01:28:00.641217 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 499/993] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:00 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:00.693643 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-65534cb3-b26a-406a-bd1b-fd2c9d1f2614 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16b706fb-26dc-47e1-a187-af6db393b3c9"}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:00.696050 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-65534cb3-b26a-406a-bd1b-fd2c9d1f2614 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:00.702008 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65534cb3-b26a-406a-bd1b-fd2c9d1f2614 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:00.702538 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65534cb3-b26a-406a-bd1b-fd2c9d1f2614 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:00.703184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65534cb3-b26a-406a-bd1b-fd2c9d1f2614 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:00.703885 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65534cb3-b26a-406a-bd1b-fd2c9d1f2614 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:00.704379 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65534cb3-b26a-406a-bd1b-fd2c9d1f2614 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:00.704833 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-65534cb3-b26a-406a-bd1b-fd2c9d1f2614 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:00.780184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=100 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:00.959338 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-65534cb3-b26a-406a-bd1b-fd2c9d1f2614 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "POST /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270064 Sep 13 01:28:00.959957 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 495/994] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:28:00 2022] POST /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:28:06.439846 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-88424684-aa07-4c72-b13f-b92cb95878e2 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:06.440512 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-88424684-aa07-4c72-b13f-b92cb95878e2 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:06.444054 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-61c37688-b10e-4d5c-a553-524894cc0392 req-9e0497b0-06b0-4185-a330-2bd29d838a34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9685ccea-9ac8-4b1b-9311-2b67570eed43", "tag": "75f99f30-6170-4344-b9f7-a80eeee96ba2"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:06.448264 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-88424684-aa07-4c72-b13f-b92cb95878e2 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:06.448754 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-88424684-aa07-4c72-b13f-b92cb95878e2 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:06.449188 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-88424684-aa07-4c72-b13f-b92cb95878e2 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:06.449891 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-88424684-aa07-4c72-b13f-b92cb95878e2 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:06.450390 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-88424684-aa07-4c72-b13f-b92cb95878e2 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:06.450835 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-88424684-aa07-4c72-b13f-b92cb95878e2 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:06.454518 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-61c37688-b10e-4d5c-a553-524894cc0392 req-9e0497b0-06b0-4185-a330-2bd29d838a34 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:06.456102 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-61c37688-b10e-4d5c-a553-524894cc0392 req-9e0497b0-06b0-4185-a330-2bd29d838a34 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:06.456102 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-61c37688-b10e-4d5c-a553-524894cc0392 req-9e0497b0-06b0-4185-a330-2bd29d838a34 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:06.467715 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-61c37688-b10e-4d5c-a553-524894cc0392 req-9e0497b0-06b0-4185-a330-2bd29d838a34 service nova] Creating event network-changed:75f99f30-6170-4344-b9f7-a80eeee96ba2 for instance 9685ccea-9ac8-4b1b-9311-2b67570eed43 on hv-cinder-85694 Sep 13 01:28:06.472942 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-61c37688-b10e-4d5c-a553-524894cc0392 req-9e0497b0-06b0-4185-a330-2bd29d838a34 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034549 Sep 13 01:28:06.474190 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 496/995] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:28:06.478897 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-88424684-aa07-4c72-b13f-b92cb95878e2 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:28:06.564019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-88424684-aa07-4c72-b13f-b92cb95878e2 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "DELETE /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 204 len: 0 microversion: 2.1 time: 0.128051 Sep 13 01:28:06.564606 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 500/996] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:28:06 2022] DELETE /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:28:06.574306 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-2bdfae0c-ea65-4e1a-a87d-e09d97ea3be9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:06.575034 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-2bdfae0c-ea65-4e1a-a87d-e09d97ea3be9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:06.581405 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2bdfae0c-ea65-4e1a-a87d-e09d97ea3be9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:06.581900 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2bdfae0c-ea65-4e1a-a87d-e09d97ea3be9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:06.582945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2bdfae0c-ea65-4e1a-a87d-e09d97ea3be9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:06.583666 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2bdfae0c-ea65-4e1a-a87d-e09d97ea3be9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:06.584127 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2bdfae0c-ea65-4e1a-a87d-e09d97ea3be9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:06.584557 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-2bdfae0c-ea65-4e1a-a87d-e09d97ea3be9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:06.722662 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-2bdfae0c-ea65-4e1a-a87d-e09d97ea3be9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:06.731290 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-2bdfae0c-ea65-4e1a-a87d-e09d97ea3be9 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1578 microversion: 2.1 time: 0.161381 Sep 13 01:28:06.739114 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 497/997] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:06 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1578 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:07.756947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-a706da2e-28aa-455a-b656-9182ea8e310f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:07.757654 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-a706da2e-28aa-455a-b656-9182ea8e310f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:07.764619 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a706da2e-28aa-455a-b656-9182ea8e310f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:07.765117 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a706da2e-28aa-455a-b656-9182ea8e310f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:07.765559 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a706da2e-28aa-455a-b656-9182ea8e310f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:07.766269 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a706da2e-28aa-455a-b656-9182ea8e310f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:07.766729 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a706da2e-28aa-455a-b656-9182ea8e310f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:07.767181 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-a706da2e-28aa-455a-b656-9182ea8e310f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:07.899758 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-a706da2e-28aa-455a-b656-9182ea8e310f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:07.907703 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-a706da2e-28aa-455a-b656-9182ea8e310f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1578 microversion: 2.1 time: 0.155762 Sep 13 01:28:07.908294 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 501/998] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:07 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:08.931036 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-70787dd6-437c-4a3f-866b-a8b6f4620c5c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:08.931638 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-70787dd6-437c-4a3f-866b-a8b6f4620c5c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:08.934086 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:08.939294 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-70787dd6-437c-4a3f-866b-a8b6f4620c5c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:08.939778 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-70787dd6-437c-4a3f-866b-a8b6f4620c5c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:08.940212 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-70787dd6-437c-4a3f-866b-a8b6f4620c5c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:08.940915 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-70787dd6-437c-4a3f-866b-a8b6f4620c5c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:08.941995 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-70787dd6-437c-4a3f-866b-a8b6f4620c5c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:08.942349 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-70787dd6-437c-4a3f-866b-a8b6f4620c5c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:09.074207 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-70787dd6-437c-4a3f-866b-a8b6f4620c5c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:09.082475 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-70787dd6-437c-4a3f-866b-a8b6f4620c5c tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1578 microversion: 2.1 time: 0.155033 Sep 13 01:28:09.083067 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 498/999] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:08 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:10.105438 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-26b7cceb-0b4a-4ff7-8883-1bc6e022c1bb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:10.106077 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-26b7cceb-0b4a-4ff7-8883-1bc6e022c1bb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:10.108562 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:10.114762 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-26b7cceb-0b4a-4ff7-8883-1bc6e022c1bb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:10.115147 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-26b7cceb-0b4a-4ff7-8883-1bc6e022c1bb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:10.115582 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-26b7cceb-0b4a-4ff7-8883-1bc6e022c1bb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:10.116281 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-26b7cceb-0b4a-4ff7-8883-1bc6e022c1bb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:10.116733 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-26b7cceb-0b4a-4ff7-8883-1bc6e022c1bb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:10.117157 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-26b7cceb-0b4a-4ff7-8883-1bc6e022c1bb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:10.244949 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-26b7cceb-0b4a-4ff7-8883-1bc6e022c1bb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:10.252653 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-26b7cceb-0b4a-4ff7-8883-1bc6e022c1bb tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1578 microversion: 2.1 time: 0.151094 Sep 13 01:28:10.253153 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 502/1000] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:10 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:11.276580 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9af5f175-bb04-4239-a334-401b7e114a8d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:11.277167 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9af5f175-bb04-4239-a334-401b7e114a8d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:11.279532 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=3 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:11.284604 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9af5f175-bb04-4239-a334-401b7e114a8d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:11.285106 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9af5f175-bb04-4239-a334-401b7e114a8d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:11.285532 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9af5f175-bb04-4239-a334-401b7e114a8d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:11.286209 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9af5f175-bb04-4239-a334-401b7e114a8d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:11.286653 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9af5f175-bb04-4239-a334-401b7e114a8d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:11.287096 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9af5f175-bb04-4239-a334-401b7e114a8d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:11.414237 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-9af5f175-bb04-4239-a334-401b7e114a8d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:11.421942 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9af5f175-bb04-4239-a334-401b7e114a8d tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1578 microversion: 2.1 time: 0.149169 Sep 13 01:28:11.422506 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 499/1001] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:11 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1578 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:12.446218 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-d5f145e1-e69d-4d6f-bcbd-e1aea92d1144 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:12.446833 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-d5f145e1-e69d-4d6f-bcbd-e1aea92d1144 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:12.452975 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d5f145e1-e69d-4d6f-bcbd-e1aea92d1144 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:12.453457 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d5f145e1-e69d-4d6f-bcbd-e1aea92d1144 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:12.453895 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d5f145e1-e69d-4d6f-bcbd-e1aea92d1144 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:12.454577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d5f145e1-e69d-4d6f-bcbd-e1aea92d1144 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:12.455067 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d5f145e1-e69d-4d6f-bcbd-e1aea92d1144 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:12.455486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-d5f145e1-e69d-4d6f-bcbd-e1aea92d1144 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:12.589364 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-d5f145e1-e69d-4d6f-bcbd-e1aea92d1144 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:12.597168 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-d5f145e1-e69d-4d6f-bcbd-e1aea92d1144 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1578 microversion: 2.1 time: 0.154804 Sep 13 01:28:12.598225 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 503/1002] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:12 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:13.621705 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-24e4df4e-1e13-4d24-a57a-db9dcf961956 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:13.622251 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-24e4df4e-1e13-4d24-a57a-db9dcf961956 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:13.628541 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-24e4df4e-1e13-4d24-a57a-db9dcf961956 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:13.629028 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-24e4df4e-1e13-4d24-a57a-db9dcf961956 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:13.630000 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-24e4df4e-1e13-4d24-a57a-db9dcf961956 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:13.630689 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-24e4df4e-1e13-4d24-a57a-db9dcf961956 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:13.631170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-24e4df4e-1e13-4d24-a57a-db9dcf961956 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:13.631596 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-24e4df4e-1e13-4d24-a57a-db9dcf961956 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:13.767177 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-24e4df4e-1e13-4d24-a57a-db9dcf961956 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:13.774959 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-24e4df4e-1e13-4d24-a57a-db9dcf961956 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1578 microversion: 2.1 time: 0.157204 Sep 13 01:28:13.775532 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 500/1003] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:13 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1578 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:14.803664 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ff99817b-6854-4805-a40c-4363b8962573 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:14.804386 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-ff99817b-6854-4805-a40c-4363b8962573 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:14.812072 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff99817b-6854-4805-a40c-4363b8962573 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:14.817453 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff99817b-6854-4805-a40c-4363b8962573 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:14.817971 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff99817b-6854-4805-a40c-4363b8962573 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:14.818720 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff99817b-6854-4805-a40c-4363b8962573 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:14.819229 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff99817b-6854-4805-a40c-4363b8962573 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:14.819656 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-ff99817b-6854-4805-a40c-4363b8962573 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:14.835357 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-906828df-4cad-4905-9743-d525a89f9d3e tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65fda750-6d3a-445f-85ef-0dd9c4770684", "device": "/dev/sdb"}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:14.838586 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-906828df-4cad-4905-9743-d525a89f9d3e tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:14.845049 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-906828df-4cad-4905-9743-d525a89f9d3e tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:14.845515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-906828df-4cad-4905-9743-d525a89f9d3e tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:14.846163 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-906828df-4cad-4905-9743-d525a89f9d3e tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:14.847215 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-906828df-4cad-4905-9743-d525a89f9d3e tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:14.848031 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-906828df-4cad-4905-9743-d525a89f9d3e tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:14.848680 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-906828df-4cad-4905-9743-d525a89f9d3e tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:14.908532 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-ff99817b-6854-4805-a40c-4363b8962573 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:14.920753 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ff99817b-6854-4805-a40c-4363b8962573 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 200 len: 1393 microversion: 2.1 time: 0.122917 Sep 13 01:28:14.921992 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 504/1004] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:14 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 1393 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:14.941463 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-0283a661-1011-4936-bbb1-1749abe05eec req-16086d4b-36cc-40e8-ac88-d0d06e43bc5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9685ccea-9ac8-4b1b-9311-2b67570eed43", "name": "network-vif-deleted", "tag": "75f99f30-6170-4344-b9f7-a80eeee96ba2"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:14.951706 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-0283a661-1011-4936-bbb1-1749abe05eec req-16086d4b-36cc-40e8-ac88-d0d06e43bc5a service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:14.952193 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-0283a661-1011-4936-bbb1-1749abe05eec req-16086d4b-36cc-40e8-ac88-d0d06e43bc5a service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:14.952618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-0283a661-1011-4936-bbb1-1749abe05eec req-16086d4b-36cc-40e8-ac88-d0d06e43bc5a service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:14.964572 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-0283a661-1011-4936-bbb1-1749abe05eec req-16086d4b-36cc-40e8-ac88-d0d06e43bc5a service nova] Creating event network-vif-deleted:75f99f30-6170-4344-b9f7-a80eeee96ba2 for instance 9685ccea-9ac8-4b1b-9311-2b67570eed43 on hv-cinder-85694 Sep 13 01:28:14.969493 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-0283a661-1011-4936-bbb1-1749abe05eec req-16086d4b-36cc-40e8-ac88-d0d06e43bc5a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046074 Sep 13 01:28:14.970129 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 505/1005] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:28:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:28:14.975486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-64a3f0e3-fc49-4945-a966-3ac291148f48 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:14.976255 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-64a3f0e3-fc49-4945-a966-3ac291148f48 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:14.983381 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64a3f0e3-fc49-4945-a966-3ac291148f48 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:14.983896 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64a3f0e3-fc49-4945-a966-3ac291148f48 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:14.984420 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64a3f0e3-fc49-4945-a966-3ac291148f48 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:14.985129 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64a3f0e3-fc49-4945-a966-3ac291148f48 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:14.985691 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64a3f0e3-fc49-4945-a966-3ac291148f48 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:14.986647 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-64a3f0e3-fc49-4945-a966-3ac291148f48 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:15.119795 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-906828df-4cad-4905-9743-d525a89f9d3e tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "POST /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289303 Sep 13 01:28:15.121324 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 501/1006] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:28:14 2022] POST /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:28:15.148317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-64a3f0e3-fc49-4945-a966-3ac291148f48 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:15.159800 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-64a3f0e3-fc49-4945-a966-3ac291148f48 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1595 microversion: 2.1 time: 0.188493 Sep 13 01:28:15.161062 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 506/1007] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:14 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1595 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:15.946037 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-571d1f0b-9d81-4c2b-a9f7-95457768f497 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:15.946788 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-571d1f0b-9d81-4c2b-a9f7-95457768f497 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 9685ccea-9ac8-4b1b-9311-2b67570eed43] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:15.952894 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-571d1f0b-9d81-4c2b-a9f7-95457768f497 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:15.953386 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-571d1f0b-9d81-4c2b-a9f7-95457768f497 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:15.953824 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-571d1f0b-9d81-4c2b-a9f7-95457768f497 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:15.954514 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-571d1f0b-9d81-4c2b-a9f7-95457768f497 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:15.955001 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-571d1f0b-9d81-4c2b-a9f7-95457768f497 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:15.955426 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-571d1f0b-9d81-4c2b-a9f7-95457768f497 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:15.968783 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-571d1f0b-9d81-4c2b-a9f7-95457768f497 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] HTTP exception thrown: Instance 9685ccea-9ac8-4b1b-9311-2b67570eed43 could not be found. Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-571d1f0b-9d81-4c2b-a9f7-95457768f497 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Request method failure captured: Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 HTTP/1.1 Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9rUf8JghhfO2JSuF4NmbKpLH7rIR3LCCeuIZBor8zAtI3fZiVe4BZ1a2fiBJtOj9Wdhbr_709vQkeJB6Cjx0psCjHnBu3C-BJeO8em2S61kObWLH8mUDyCoDJV7tMjCliMEAUCq_jr1i4NrR19gjZ-KSh11gbCX6Ea8dpXn6NDyc3k Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 66cdd4ec03ea4fbf959ede65bb96f6ca Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-TestVolumeBootPattern-921936311 Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:28:15.970445 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:28:15.972380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}] Sep 13 01:28:15.972380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-TestVolumeBootPattern-921936311 Sep 13 01:28:15.972380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 66cdd4ec03ea4fbf959ede65bb96f6ca Sep 13 01:28:15.972380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-TestVolumeBootPattern-921936311 Sep 13 01:28:15.972380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-TestVolumeBootPattern-921936311-project Sep 13 01:28:15.972380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:28:15.972380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:28:15.972380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 2842b222fe6b4821a670d13ec8febf1a Sep 13 01:28:15.972380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-TestVolumeBootPattern-921936311-project Sep 13 01:28:15.972380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:28:15.972380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 9685ccea-9ac8-4b1b-9311-2b67570eed43 could not be found. Sep 13 01:28:15.972380 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '9685ccea-9ac8-4b1b-9311-2b67570eed43'} Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9685ccea-9ac8-4b1b-9311-2b67570eed43 could not be found. Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:28:15.973406 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9685ccea-9ac8-4b1b-9311-2b67570eed43 could not be found. Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9685ccea-9ac8-4b1b-9311-2b67570eed43 could not be found. Sep 13 01:28:15.974793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:15.976264 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-571d1f0b-9d81-4c2b-a9f7-95457768f497 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Returning 404 to user: Instance 9685ccea-9ac8-4b1b-9311-2b67570eed43 could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:28:15.976264 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-571d1f0b-9d81-4c2b-a9f7-95457768f497 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43" status: 404 len: 111 microversion: 2.1 time: 0.031224 Sep 13 01:28:15.976264 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 502/1008] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:15 2022] GET /compute/v2.1/servers/9685ccea-9ac8-4b1b-9311-2b67570eed43 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:28:17.230668 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-4ce49d84-a8f6-4515-972b-44ff1aee425b req-636dc9b2-c049-4731-b94d-b850eae0ca97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d2d899-2749-4525-a1c3-a96617c5d619", "tag": "1012c39b-1d73-4b31-9a78-4519d95f4972"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:17.242061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-4ce49d84-a8f6-4515-972b-44ff1aee425b req-636dc9b2-c049-4731-b94d-b850eae0ca97 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:17.242902 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-4ce49d84-a8f6-4515-972b-44ff1aee425b req-636dc9b2-c049-4731-b94d-b850eae0ca97 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:17.243329 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-4ce49d84-a8f6-4515-972b-44ff1aee425b req-636dc9b2-c049-4731-b94d-b850eae0ca97 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:17.255646 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-4ce49d84-a8f6-4515-972b-44ff1aee425b req-636dc9b2-c049-4731-b94d-b850eae0ca97 service nova] Creating event network-changed:1012c39b-1d73-4b31-9a78-4519d95f4972 for instance 09d2d899-2749-4525-a1c3-a96617c5d619 on hv-cinder-85694 Sep 13 01:28:17.260683 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-4ce49d84-a8f6-4515-972b-44ff1aee425b req-636dc9b2-c049-4731-b94d-b850eae0ca97 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033752 Sep 13 01:28:17.261291 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 507/1009] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:28:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:28:18.255871 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-9a541e60-0b30-4b27-9352-fdf9acf89de4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1894512115"}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:18.256485 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-9a541e60-0b30-4b27-9352-fdf9acf89de4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:18.263592 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9a541e60-0b30-4b27-9352-fdf9acf89de4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:18.264155 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9a541e60-0b30-4b27-9352-fdf9acf89de4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:18.264808 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9a541e60-0b30-4b27-9352-fdf9acf89de4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:18.265577 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9a541e60-0b30-4b27-9352-fdf9acf89de4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:18.266100 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9a541e60-0b30-4b27-9352-fdf9acf89de4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:18.266665 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-9a541e60-0b30-4b27-9352-fdf9acf89de4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:18.523062 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.network.security_group_api [None req-9a541e60-0b30-4b27-9352-fdf9acf89de4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Adding security group a629ad1a-05d9-41bb-83de-d3d8353194db to port 1012c39b-1d73-4b31-9a78-4519d95f4972 Sep 13 01:28:19.031256 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-9a541e60-0b30-4b27-9352-fdf9acf89de4 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "POST /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/action" status: 202 len: 0 microversion: 2.1 time: 0.779437 Sep 13 01:28:19.032936 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 503/1010] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:28:18 2022] POST /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/action => generated 0 bytes in 781 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:28:19.041624 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-10172fe3-8603-4d32-b2ff-0865ac347bad tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:19.042522 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-10172fe3-8603-4d32-b2ff-0865ac347bad tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:19.048947 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-10172fe3-8603-4d32-b2ff-0865ac347bad tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:19.049624 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-10172fe3-8603-4d32-b2ff-0865ac347bad tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:19.050165 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-10172fe3-8603-4d32-b2ff-0865ac347bad tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:19.051496 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-10172fe3-8603-4d32-b2ff-0865ac347bad tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:19.052354 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-10172fe3-8603-4d32-b2ff-0865ac347bad tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:19.053788 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-10172fe3-8603-4d32-b2ff-0865ac347bad tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:19.214168 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-10172fe3-8603-4d32-b2ff-0865ac347bad tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:19.223981 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-10172fe3-8603-4d32-b2ff-0865ac347bad tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1761 microversion: 2.1 time: 0.187344 Sep 13 01:28:19.224888 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 508/1011] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:19 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1761 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:19.281325 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-68015f22-8749-43b4-9026-f70356b8f6da req-48011b93-6556-4200-b142-5629a770e8a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d2d899-2749-4525-a1c3-a96617c5d619", "tag": "1012c39b-1d73-4b31-9a78-4519d95f4972"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:19.292528 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-68015f22-8749-43b4-9026-f70356b8f6da req-48011b93-6556-4200-b142-5629a770e8a3 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:19.293012 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-68015f22-8749-43b4-9026-f70356b8f6da req-48011b93-6556-4200-b142-5629a770e8a3 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:19.293440 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-68015f22-8749-43b4-9026-f70356b8f6da req-48011b93-6556-4200-b142-5629a770e8a3 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:19.305919 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-68015f22-8749-43b4-9026-f70356b8f6da req-48011b93-6556-4200-b142-5629a770e8a3 service nova] Creating event network-changed:1012c39b-1d73-4b31-9a78-4519d95f4972 for instance 09d2d899-2749-4525-a1c3-a96617c5d619 on hv-cinder-85694 Sep 13 01:28:19.311192 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-68015f22-8749-43b4-9026-f70356b8f6da req-48011b93-6556-4200-b142-5629a770e8a3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034510 Sep 13 01:28:19.312013 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 504/1012] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:28:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:28:19.800638 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-8de5161b-0ef1-4f3b-ab67-19d59249e96f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:19.801677 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8de5161b-0ef1-4f3b-ab67-19d59249e96f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:19.808117 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8de5161b-0ef1-4f3b-ab67-19d59249e96f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:19.808609 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8de5161b-0ef1-4f3b-ab67-19d59249e96f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:19.809043 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8de5161b-0ef1-4f3b-ab67-19d59249e96f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:19.809972 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8de5161b-0ef1-4f3b-ab67-19d59249e96f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:19.810434 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8de5161b-0ef1-4f3b-ab67-19d59249e96f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:19.810888 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-8de5161b-0ef1-4f3b-ab67-19d59249e96f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:19.837734 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-8de5161b-0ef1-4f3b-ab67-19d59249e96f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:28:19.923019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-8de5161b-0ef1-4f3b-ab67-19d59249e96f tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 204 len: 0 microversion: 2.1 time: 0.126003 Sep 13 01:28:19.923941 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 509/1013] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:28:19 2022] DELETE /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:28:19.933864 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a8b06a96-0ca4-410d-9ba2-05868488e2ea tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:19.934884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a8b06a96-0ca4-410d-9ba2-05868488e2ea tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:19.942142 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a8b06a96-0ca4-410d-9ba2-05868488e2ea tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:19.942885 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a8b06a96-0ca4-410d-9ba2-05868488e2ea tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:19.943333 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a8b06a96-0ca4-410d-9ba2-05868488e2ea tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:19.944035 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a8b06a96-0ca4-410d-9ba2-05868488e2ea tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:19.944484 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a8b06a96-0ca4-410d-9ba2-05868488e2ea tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:19.944902 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a8b06a96-0ca4-410d-9ba2-05868488e2ea tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:20.076488 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a8b06a96-0ca4-410d-9ba2-05868488e2ea tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:20.084585 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a8b06a96-0ca4-410d-9ba2-05868488e2ea tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1577 microversion: 2.1 time: 0.154836 Sep 13 01:28:20.084912 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 505/1014] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:19 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:21.108317 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6e4e4f98-3a32-4522-b881-35a79dbb84b0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:21.109007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6e4e4f98-3a32-4522-b881-35a79dbb84b0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:21.115296 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6e4e4f98-3a32-4522-b881-35a79dbb84b0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:21.115778 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6e4e4f98-3a32-4522-b881-35a79dbb84b0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:21.116332 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6e4e4f98-3a32-4522-b881-35a79dbb84b0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:21.117021 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6e4e4f98-3a32-4522-b881-35a79dbb84b0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:21.117471 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6e4e4f98-3a32-4522-b881-35a79dbb84b0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:21.117889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6e4e4f98-3a32-4522-b881-35a79dbb84b0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:21.245355 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6e4e4f98-3a32-4522-b881-35a79dbb84b0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:21.252882 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6e4e4f98-3a32-4522-b881-35a79dbb84b0 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1577 microversion: 2.1 time: 0.148801 Sep 13 01:28:21.253441 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 510/1015] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:21 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1577 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:21.331221 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-fb3f0484-2933-48c5-89d3-d2d8c0be8a34 req-5792dca2-8ece-49c9-9e49-c61f0b76cb22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bfba6992-16f5-4e5a-b9d4-975bdf6f8e81", "tag": "4195c70c-e59e-4802-a081-867a4bbc8d9f"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:21.340971 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-fb3f0484-2933-48c5-89d3-d2d8c0be8a34 req-5792dca2-8ece-49c9-9e49-c61f0b76cb22 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:21.341447 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-fb3f0484-2933-48c5-89d3-d2d8c0be8a34 req-5792dca2-8ece-49c9-9e49-c61f0b76cb22 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:21.341877 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-fb3f0484-2933-48c5-89d3-d2d8c0be8a34 req-5792dca2-8ece-49c9-9e49-c61f0b76cb22 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:21.352629 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-fb3f0484-2933-48c5-89d3-d2d8c0be8a34 req-5792dca2-8ece-49c9-9e49-c61f0b76cb22 service nova] Creating event network-changed:4195c70c-e59e-4802-a081-867a4bbc8d9f for instance bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 on hv-cinder-85694 Sep 13 01:28:21.357411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-fb3f0484-2933-48c5-89d3-d2d8c0be8a34 req-5792dca2-8ece-49c9-9e49-c61f0b76cb22 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029820 Sep 13 01:28:21.358029 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 506/1016] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:28:22.276948 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-2661f071-bb6c-4893-8d93-c82da008f18b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:22.277475 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-2661f071-bb6c-4893-8d93-c82da008f18b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:22.283927 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2661f071-bb6c-4893-8d93-c82da008f18b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:22.284439 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2661f071-bb6c-4893-8d93-c82da008f18b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:22.284876 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2661f071-bb6c-4893-8d93-c82da008f18b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:22.285605 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2661f071-bb6c-4893-8d93-c82da008f18b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:22.286060 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2661f071-bb6c-4893-8d93-c82da008f18b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:22.286536 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-2661f071-bb6c-4893-8d93-c82da008f18b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:22.420624 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-2661f071-bb6c-4893-8d93-c82da008f18b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:22.428606 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-2661f071-bb6c-4893-8d93-c82da008f18b tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1577 microversion: 2.1 time: 0.155679 Sep 13 01:28:22.429261 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 511/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:22 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:23.374071 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-7f7d629c-ac08-45b8-b234-ca7143558c5f req-f237531f-1e94-44d8-ab96-b4a9fb2fa439 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bfba6992-16f5-4e5a-b9d4-975bdf6f8e81", "name": "network-vif-deleted", "tag": "4195c70c-e59e-4802-a081-867a4bbc8d9f"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:23.383467 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-7f7d629c-ac08-45b8-b234-ca7143558c5f req-f237531f-1e94-44d8-ab96-b4a9fb2fa439 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:23.383942 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-7f7d629c-ac08-45b8-b234-ca7143558c5f req-f237531f-1e94-44d8-ab96-b4a9fb2fa439 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:23.384373 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-7f7d629c-ac08-45b8-b234-ca7143558c5f req-f237531f-1e94-44d8-ab96-b4a9fb2fa439 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:23.395286 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-7f7d629c-ac08-45b8-b234-ca7143558c5f req-f237531f-1e94-44d8-ab96-b4a9fb2fa439 service nova] Creating event network-vif-deleted:4195c70c-e59e-4802-a081-867a4bbc8d9f for instance bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 on hv-cinder-85694 Sep 13 01:28:23.400055 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-7f7d629c-ac08-45b8-b234-ca7143558c5f req-f237531f-1e94-44d8-ab96-b4a9fb2fa439 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030448 Sep 13 01:28:23.400651 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 507/1018] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:28:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:28:23.451472 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:23.452088 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:23.458983 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:23.459469 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:23.459905 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:23.460603 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:23.461056 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:23.461480 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:23.491598 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:23.492074 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:23.492513 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:23.492953 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lazy-loading 'fault' on Instance uuid bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:28:23.532029 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:23.540155 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-b0cc1852-9eb6-4897-8bbf-33872b7943aa tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1231 microversion: 2.1 time: 0.092534 Sep 13 01:28:23.540711 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 512/1019] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:23 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1231 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:24.564327 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:24.565027 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:24.571074 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:24.571553 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:24.571985 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:24.572666 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:24.573116 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:24.573540 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:24.603447 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:24.603923 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:24.604355 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:24.604795 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lazy-loading 'fault' on Instance uuid bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:28:24.644903 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:24.652440 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-8c17595b-6868-432d-8a42-e4735179a971 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1231 microversion: 2.1 time: 0.092745 Sep 13 01:28:24.653004 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 508/1020] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:24 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1231 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:25.676144 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:25.676991 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:25.683344 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:25.683829 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:25.684267 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:25.684958 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:25.685414 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:25.685835 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:25.717609 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:25.718084 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:25.718517 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:25.718990 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lazy-loading 'fault' on Instance uuid bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:28:25.758682 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2842b222fe6b4821a670d13ec8febf1a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66cdd4ec03ea4fbf959ede65bb96f6ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:25.762152 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:25.767150 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-912b5519-d4db-4992-ad09-4752d1ed11e3 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 200 len: 1231 microversion: 2.1 time: 0.095428 Sep 13 01:28:25.767722 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 513/1021] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:25 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:26.790001 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-60b877b8-6d80-42a3-a2cf-b0b93d0bf82a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:26.790607 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-60b877b8-6d80-42a3-a2cf-b0b93d0bf82a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: bfba6992-16f5-4e5a-b9d4-975bdf6f8e81] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:26.796960 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-60b877b8-6d80-42a3-a2cf-b0b93d0bf82a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:26.797438 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-60b877b8-6d80-42a3-a2cf-b0b93d0bf82a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:26.797869 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-60b877b8-6d80-42a3-a2cf-b0b93d0bf82a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:26.798550 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-60b877b8-6d80-42a3-a2cf-b0b93d0bf82a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:26.799037 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-60b877b8-6d80-42a3-a2cf-b0b93d0bf82a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:26.799458 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-60b877b8-6d80-42a3-a2cf-b0b93d0bf82a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:26.813777 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-60b877b8-6d80-42a3-a2cf-b0b93d0bf82a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] HTTP exception thrown: Instance bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 could not be found. Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-60b877b8-6d80-42a3-a2cf-b0b93d0bf82a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Request method failure captured: Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 HTTP/1.1 Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9rUf8JghhfO2JSuF4NmbKpLH7rIR3LCCeuIZBor8zAtI3fZiVe4BZ1a2fiBJtOj9Wdhbr_709vQkeJB6Cjx0psCjHnBu3C-BJeO8em2S61kObWLH8mUDyCoDJV7tMjCliMEAUCq_jr1i4NrR19gjZ-KSh11gbCX6Ea8dpXn6NDyc3k Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 66cdd4ec03ea4fbf959ede65bb96f6ca Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-TestVolumeBootPattern-921936311 Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:28:26.815411 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:28:26.817450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}] Sep 13 01:28:26.817450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-TestVolumeBootPattern-921936311 Sep 13 01:28:26.817450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 66cdd4ec03ea4fbf959ede65bb96f6ca Sep 13 01:28:26.817450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-TestVolumeBootPattern-921936311 Sep 13 01:28:26.817450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-TestVolumeBootPattern-921936311-project Sep 13 01:28:26.817450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:28:26.817450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:28:26.817450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 2842b222fe6b4821a670d13ec8febf1a Sep 13 01:28:26.817450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-TestVolumeBootPattern-921936311-project Sep 13 01:28:26.817450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:28:26.817450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 could not be found. Sep 13 01:28:26.817450 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': 'bfba6992-16f5-4e5a-b9d4-975bdf6f8e81'} Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 could not be found. Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:28:26.818308 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 could not be found. Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 could not be found. Sep 13 01:28:26.819945 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:26.821418 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-60b877b8-6d80-42a3-a2cf-b0b93d0bf82a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Returning 404 to user: Instance bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:28:26.821418 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-60b877b8-6d80-42a3-a2cf-b0b93d0bf82a tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81" status: 404 len: 111 microversion: 2.1 time: 0.031116 Sep 13 01:28:26.821418 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 509/1022] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:26 2022] GET /compute/v2.1/servers/bfba6992-16f5-4e5a-b9d4-975bdf6f8e81 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:28:27.242006 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7fe61b5b-1af4-4353-ae20-5398581662e6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:27.242507 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7fe61b5b-1af4-4353-ae20-5398581662e6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:27.249752 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7fe61b5b-1af4-4353-ae20-5398581662e6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:27.250240 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7fe61b5b-1af4-4353-ae20-5398581662e6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:27.250677 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7fe61b5b-1af4-4353-ae20-5398581662e6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:27.251403 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7fe61b5b-1af4-4353-ae20-5398581662e6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:27.251862 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7fe61b5b-1af4-4353-ae20-5398581662e6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:27.252290 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7fe61b5b-1af4-4353-ae20-5398581662e6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:27.267007 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-7fe61b5b-1af4-4353-ae20-5398581662e6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] HTTP exception thrown: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7fe61b5b-1af4-4353-ae20-5398581662e6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Request method failure captured: Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c HTTP/1.1 Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9rUf8JghhfO2JSuF4NmbKpLH7rIR3LCCeuIZBor8zAtI3fZiVe4BZ1a2fiBJtOj9Wdhbr_709vQkeJB6Cjx0psCjHnBu3C-BJeO8em2S61kObWLH8mUDyCoDJV7tMjCliMEAUCq_jr1i4NrR19gjZ-KSh11gbCX6Ea8dpXn6NDyc3k Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 66cdd4ec03ea4fbf959ede65bb96f6ca Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-TestVolumeBootPattern-921936311 Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:28:27.268663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:28:27.270429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}] Sep 13 01:28:27.270429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-TestVolumeBootPattern-921936311 Sep 13 01:28:27.270429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 66cdd4ec03ea4fbf959ede65bb96f6ca Sep 13 01:28:27.270429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-TestVolumeBootPattern-921936311 Sep 13 01:28:27.270429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-TestVolumeBootPattern-921936311-project Sep 13 01:28:27.270429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:28:27.270429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:28:27.270429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: 2842b222fe6b4821a670d13ec8febf1a Sep 13 01:28:27.270429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-TestVolumeBootPattern-921936311-project Sep 13 01:28:27.270429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:28:27.270429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:28:27.270429 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '8555c188-5c8f-4a84-877b-c97fe0265c5c'} Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:28:27.271346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:28:27.272942 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:28:27.274694 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7fe61b5b-1af4-4353-ae20-5398581662e6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Returning 404 to user: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:28:27.274694 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7fe61b5b-1af4-4353-ae20-5398581662e6 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 404 len: 111 microversion: 2.1 time: 0.032360 Sep 13 01:28:27.274694 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 514/1023] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:28:27 2022] DELETE /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:28:27.278791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ca21cbb0-05f8-4256-bc23-7ebb25b41d39 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:27.279434 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ca21cbb0-05f8-4256-bc23-7ebb25b41d39 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] [instance: 8555c188-5c8f-4a84-877b-c97fe0265c5c] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:27.285268 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ca21cbb0-05f8-4256-bc23-7ebb25b41d39 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:27.285743 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ca21cbb0-05f8-4256-bc23-7ebb25b41d39 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:27.286173 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ca21cbb0-05f8-4256-bc23-7ebb25b41d39 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:27.286863 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ca21cbb0-05f8-4256-bc23-7ebb25b41d39 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:27.287320 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ca21cbb0-05f8-4256-bc23-7ebb25b41d39 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:27.287731 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ca21cbb0-05f8-4256-bc23-7ebb25b41d39 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:27.301067 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-ca21cbb0-05f8-4256-bc23-7ebb25b41d39 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] HTTP exception thrown: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ca21cbb0-05f8-4256-bc23-7ebb25b41d39 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Request method failure captured: Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c HTTP/1.1 Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9rUf8JghhfO2JSuF4NmbKpLH7rIR3LCCeuIZBor8zAtI3fZiVe4BZ1a2fiBJtOj9Wdhbr_709vQkeJB6Cjx0psCjHnBu3C-BJeO8em2S61kObWLH8mUDyCoDJV7tMjCliMEAUCq_jr1i4NrR19gjZ-KSh11gbCX6Ea8dpXn6NDyc3k Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 66cdd4ec03ea4fbf959ede65bb96f6ca Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-TestVolumeBootPattern-921936311 Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:28:27.302820 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:28:27.304511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/66cdd4ec03ea4fbf959ede65bb96f6ca"}]}] Sep 13 01:28:27.304511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-TestVolumeBootPattern-921936311 Sep 13 01:28:27.304511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 66cdd4ec03ea4fbf959ede65bb96f6ca Sep 13 01:28:27.304511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-TestVolumeBootPattern-921936311 Sep 13 01:28:27.304511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-TestVolumeBootPattern-921936311-project Sep 13 01:28:27.304511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:28:27.304511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:28:27.304511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: 2842b222fe6b4821a670d13ec8febf1a Sep 13 01:28:27.304511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-TestVolumeBootPattern-921936311-project Sep 13 01:28:27.304511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:28:27.304511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:28:27.304511 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': '8555c188-5c8f-4a84-877b-c97fe0265c5c'} Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:28:27.305453 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. Sep 13 01:28:27.307011 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:27.308798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ca21cbb0-05f8-4256-bc23-7ebb25b41d39 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Returning 404 to user: Instance 8555c188-5c8f-4a84-877b-c97fe0265c5c could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:28:27.308798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ca21cbb0-05f8-4256-bc23-7ebb25b41d39 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c" status: 404 len: 111 microversion: 2.1 time: 0.029475 Sep 13 01:28:27.308798 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 510/1024] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:27 2022] GET /compute/v2.1/servers/8555c188-5c8f-4a84-877b-c97fe0265c5c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 13 01:28:29.641338 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-ba4be95d-6a2a-46ba-9902-f9ac5671ea55 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] Calling method '.version_select at 0x7fb061d119d0>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:29.661388 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-ba4be95d-6a2a-46ba-9902-f9ac5671ea55 tempest-TestVolumeBootPattern-921936311 tempest-TestVolumeBootPattern-921936311-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1305807284" status: 202 len: 0 microversion: 2.1 time: 0.023833 Sep 13 01:28:29.665940 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 515/1025] 10.222.0.15 () {58 vars in 1263 bytes} [Tue Sep 13 01:28:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1305807284 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:28:37.960901 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-3e8b4033-5961-41bb-ba2f-8a67be119b35 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:37.961452 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-3e8b4033-5961-41bb-ba2f-8a67be119b35 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:37.964025 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=25 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:37.964885 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:37.970415 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e8b4033-5961-41bb-ba2f-8a67be119b35 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:37.970921 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e8b4033-5961-41bb-ba2f-8a67be119b35 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:37.971363 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e8b4033-5961-41bb-ba2f-8a67be119b35 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:37.972048 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e8b4033-5961-41bb-ba2f-8a67be119b35 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:37.972503 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e8b4033-5961-41bb-ba2f-8a67be119b35 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:37.972925 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-3e8b4033-5961-41bb-ba2f-8a67be119b35 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:38.275652 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-3e8b4033-5961-41bb-ba2f-8a67be119b35 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lazy-loading 'services' on Instance uuid bbdde643-e612-4f6f-8f73-28e8a20a6236 {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:28:38.347212 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-3e8b4033-5961-41bb-ba2f-8a67be119b35 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236/os-volume_attachments/65fda750-6d3a-445f-85ef-0dd9c4770684" status: 202 len: 0 microversion: 2.1 time: 0.389452 Sep 13 01:28:38.347791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 511/1026] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 01:28:37 2022] DELETE /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236/os-volume_attachments/65fda750-6d3a-445f-85ef-0dd9c4770684 => generated 0 bytes in 391 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:28:39.470590 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:39.474536 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-491d1f3d-64a4-4294-89a3-fbc6148b5506 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:39.475061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-491d1f3d-64a4-4294-89a3-fbc6148b5506 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:39.482061 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-491d1f3d-64a4-4294-89a3-fbc6148b5506 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:39.482544 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-491d1f3d-64a4-4294-89a3-fbc6148b5506 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:39.483019 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-491d1f3d-64a4-4294-89a3-fbc6148b5506 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:39.483713 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-491d1f3d-64a4-4294-89a3-fbc6148b5506 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:39.484165 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-491d1f3d-64a4-4294-89a3-fbc6148b5506 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:39.484585 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-491d1f3d-64a4-4294-89a3-fbc6148b5506 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:39.509172 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-491d1f3d-64a4-4294-89a3-fbc6148b5506 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Going to try to terminate instance {{(pid=120415) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:28:39.587392 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-491d1f3d-64a4-4294-89a3-fbc6148b5506 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "DELETE /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 204 len: 0 microversion: 2.1 time: 0.117680 Sep 13 01:28:39.588063 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 516/1027] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:28:39 2022] DELETE /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:28:39.598396 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-a53cdf0a-2008-4eec-80d9-4e62dadc9468 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:39.599213 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-a53cdf0a-2008-4eec-80d9-4e62dadc9468 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:39.605360 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a53cdf0a-2008-4eec-80d9-4e62dadc9468 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:39.605850 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a53cdf0a-2008-4eec-80d9-4e62dadc9468 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:39.606285 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a53cdf0a-2008-4eec-80d9-4e62dadc9468 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:39.607008 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a53cdf0a-2008-4eec-80d9-4e62dadc9468 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:39.607461 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a53cdf0a-2008-4eec-80d9-4e62dadc9468 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:39.607885 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-a53cdf0a-2008-4eec-80d9-4e62dadc9468 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:39.733565 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-a53cdf0a-2008-4eec-80d9-4e62dadc9468 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:39.741793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-a53cdf0a-2008-4eec-80d9-4e62dadc9468 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1513 microversion: 2.1 time: 0.149150 Sep 13 01:28:39.742364 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 512/1028] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:39 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1513 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:40.765079 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6c3bcf69-63f5-4772-bd31-dda8fa464a23 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:40.765776 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6c3bcf69-63f5-4772-bd31-dda8fa464a23 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:40.768357 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:40.774913 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c3bcf69-63f5-4772-bd31-dda8fa464a23 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:40.775487 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c3bcf69-63f5-4772-bd31-dda8fa464a23 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:40.775954 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c3bcf69-63f5-4772-bd31-dda8fa464a23 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:40.776657 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c3bcf69-63f5-4772-bd31-dda8fa464a23 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:40.777143 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c3bcf69-63f5-4772-bd31-dda8fa464a23 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:40.777572 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6c3bcf69-63f5-4772-bd31-dda8fa464a23 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:41.009914 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6c3bcf69-63f5-4772-bd31-dda8fa464a23 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:41.017717 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6c3bcf69-63f5-4772-bd31-dda8fa464a23 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1513 microversion: 2.1 time: 0.256793 Sep 13 01:28:41.018213 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 517/1029] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:40 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:41.638959 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-44b239c4-350a-426c-bd17-f50c066db79e req-fa3e3bbc-9331-48fa-b672-d5332d677649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bbdde643-e612-4f6f-8f73-28e8a20a6236", "name": "network-vif-deleted", "tag": "9be82c92-faec-427b-aa31-918c40122fd1"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:41.652356 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-44b239c4-350a-426c-bd17-f50c066db79e req-fa3e3bbc-9331-48fa-b672-d5332d677649 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:41.652825 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-44b239c4-350a-426c-bd17-f50c066db79e req-fa3e3bbc-9331-48fa-b672-d5332d677649 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:41.653261 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-44b239c4-350a-426c-bd17-f50c066db79e req-fa3e3bbc-9331-48fa-b672-d5332d677649 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:41.665535 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-44b239c4-350a-426c-bd17-f50c066db79e req-fa3e3bbc-9331-48fa-b672-d5332d677649 service nova] Creating event network-vif-deleted:9be82c92-faec-427b-aa31-918c40122fd1 for instance bbdde643-e612-4f6f-8f73-28e8a20a6236 on hv-cinder-85694 Sep 13 01:28:41.670299 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-44b239c4-350a-426c-bd17-f50c066db79e req-fa3e3bbc-9331-48fa-b672-d5332d677649 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038079 Sep 13 01:28:41.670910 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 513/1030] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:28:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:28:42.040098 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:42.040709 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:42.047139 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:42.047618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:42.048048 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:42.048732 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:42.049183 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:42.049601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:42.080114 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:42.080595 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:42.081070 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:42.082050 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lazy-loading 'fault' on Instance uuid bbdde643-e612-4f6f-8f73-28e8a20a6236 {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:28:42.122577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:42.130937 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e30725cf-9358-4885-8a17-96d81e678885 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 200 len: 1308 microversion: 2.1 time: 0.094621 Sep 13 01:28:42.131494 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 518/1031] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:42 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 1308 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:43.155935 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-cb74be78-a4e0-4584-9383-ae0d6a214906 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:43.156626 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-cb74be78-a4e0-4584-9383-ae0d6a214906 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: bbdde643-e612-4f6f-8f73-28e8a20a6236] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:43.163257 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cb74be78-a4e0-4584-9383-ae0d6a214906 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:43.163737 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cb74be78-a4e0-4584-9383-ae0d6a214906 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:43.164174 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cb74be78-a4e0-4584-9383-ae0d6a214906 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:43.164856 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cb74be78-a4e0-4584-9383-ae0d6a214906 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:43.165303 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cb74be78-a4e0-4584-9383-ae0d6a214906 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:43.165720 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cb74be78-a4e0-4584-9383-ae0d6a214906 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:43.179112 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.wsgi [None req-cb74be78-a4e0-4584-9383-ae0d6a214906 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] HTTP exception thrown: Instance bbdde643-e612-4f6f-8f73-28e8a20a6236 could not be found. Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-cb74be78-a4e0-4584-9383-ae0d6a214906 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Request method failure captured: Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: request: GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 HTTP/1.1 Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept: application/json Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Accept-Encoding: identity Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Connection: close Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Length: 0 Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Content-Type: application/json Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Host: 10.222.0.15 Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: Openstack-System-Scope: None Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: User-Agent: python-urllib3/1.26.12 Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Auth-Token: gAAAAABjH9yQOb4QDkVSizr-oC12em-4rI26S_5cnZYYJvB9oO1894iLjSvEiAhen0LiSmdNyJ5AquGLYQYzIcxIt93HseMsOGPnTLkaqZ-LM4CRlAyaBg0IlA2L6xDyqgc_gAMQMewzZCaR_eyotEM2_sAucBMk5VJ3mXHy0hplXO8y_-aCjuU Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Id: None Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Domain-Name: None Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Identity-Status: Confirmed Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Is-Admin-Project: True Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Id: default Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Domain-Name: Default Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Id: 53b74c0569e9452d817797f3f9d3a78f Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Project-Name: tempest-VolumesSnapshotTestJSON-658966462 Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Role: reader,member Sep 13 01:28:43.180712 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Roles: reader,member Sep 13 01:28:43.182334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_53b74c0569e9452d817797f3f9d3a78f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53b74c0569e9452d817797f3f9d3a78f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/53b74c0569e9452d817797f3f9d3a78f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53b74c0569e9452d817797f3f9d3a78f"}]}] Sep 13 01:28:43.182334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant: tempest-VolumesSnapshotTestJSON-658966462 Sep 13 01:28:43.182334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Id: 53b74c0569e9452d817797f3f9d3a78f Sep 13 01:28:43.182334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-658966462 Sep 13 01:28:43.182334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User: tempest-VolumesSnapshotTestJSON-658966462-project Sep 13 01:28:43.182334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Id: default Sep 13 01:28:43.182334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Domain-Name: Default Sep 13 01:28:43.182334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Id: ed67fb86412a404d9acd882d88432b8c Sep 13 01:28:43.182334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: X-User-Name: tempest-VolumesSnapshotTestJSON-658966462-project Sep 13 01:28:43.182334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: method: > Sep 13 01:28:43.182334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: exception: Instance bbdde643-e612-4f6f-8f73-28e8a20a6236 could not be found. Sep 13 01:28:43.182334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: action_args: {'id': 'bbdde643-e612-4f6f-8f73-28e8a20a6236'} Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bbdde643-e612-4f6f-8f73-28e8a20a6236 could not be found. Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:28:43.183326 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bbdde643-e612-4f6f-8f73-28e8a20a6236 could not be found. Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bbdde643-e612-4f6f-8f73-28e8a20a6236 could not be found. Sep 13 01:28:43.184829 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: ERROR nova.api.openstack.wsgi Sep 13 01:28:43.186222 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-cb74be78-a4e0-4584-9383-ae0d6a214906 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Returning 404 to user: Instance bbdde643-e612-4f6f-8f73-28e8a20a6236 could not be found. {{(pid=120412) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:28:43.186222 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-cb74be78-a4e0-4584-9383-ae0d6a214906 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236" status: 404 len: 111 microversion: 2.1 time: 0.030860 Sep 13 01:28:43.186222 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 514/1032] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:43 2022] GET /compute/v2.1/servers/bbdde643-e612-4f6f-8f73-28e8a20a6236 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:28:44.892161 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-caed2f38-54bd-4a19-9bae-a19fd79c0510 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:44.894530 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-caed2f38-54bd-4a19-9bae-a19fd79c0510 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:44.901103 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-caed2f38-54bd-4a19-9bae-a19fd79c0510 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:44.901590 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-caed2f38-54bd-4a19-9bae-a19fd79c0510 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:44.902063 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-caed2f38-54bd-4a19-9bae-a19fd79c0510 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:44.902755 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-caed2f38-54bd-4a19-9bae-a19fd79c0510 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:44.903258 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-caed2f38-54bd-4a19-9bae-a19fd79c0510 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:44.903697 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-caed2f38-54bd-4a19-9bae-a19fd79c0510 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:44.973471 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-caed2f38-54bd-4a19-9bae-a19fd79c0510 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "POST /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/action" status: 202 len: 0 microversion: 2.1 time: 0.085031 Sep 13 01:28:44.974082 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 519/1033] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:28:44 2022] POST /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:28:44.982118 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-071d729c-3221-4616-be0b-825f5b6ff5d6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:44.982724 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-071d729c-3221-4616-be0b-825f5b6ff5d6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:44.989861 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-071d729c-3221-4616-be0b-825f5b6ff5d6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:44.990350 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-071d729c-3221-4616-be0b-825f5b6ff5d6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:44.990791 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-071d729c-3221-4616-be0b-825f5b6ff5d6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:44.991797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-071d729c-3221-4616-be0b-825f5b6ff5d6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:44.992387 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-071d729c-3221-4616-be0b-825f5b6ff5d6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:44.992940 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-071d729c-3221-4616-be0b-825f5b6ff5d6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:45.131624 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-071d729c-3221-4616-be0b-825f5b6ff5d6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:45.139741 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-071d729c-3221-4616-be0b-825f5b6ff5d6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1753 microversion: 2.1 time: 0.161454 Sep 13 01:28:45.140303 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 515/1034] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:44 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1753 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:46.165666 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-265f81d1-a31b-4b26-aa5b-21d5eb42921c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:46.166377 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-265f81d1-a31b-4b26-aa5b-21d5eb42921c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:46.172445 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-265f81d1-a31b-4b26-aa5b-21d5eb42921c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:46.172936 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-265f81d1-a31b-4b26-aa5b-21d5eb42921c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:46.173370 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-265f81d1-a31b-4b26-aa5b-21d5eb42921c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:46.174176 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-265f81d1-a31b-4b26-aa5b-21d5eb42921c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:46.174608 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-265f81d1-a31b-4b26-aa5b-21d5eb42921c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:46.174988 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-265f81d1-a31b-4b26-aa5b-21d5eb42921c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:46.322047 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-265f81d1-a31b-4b26-aa5b-21d5eb42921c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:46.330396 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-265f81d1-a31b-4b26-aa5b-21d5eb42921c tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1753 microversion: 2.1 time: 0.169436 Sep 13 01:28:46.330987 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 520/1035] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:46 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1753 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:28:47.356925 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-5c1e5dfb-be00-4fbe-bb02-6f9648755835 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:47.357539 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-5c1e5dfb-be00-4fbe-bb02-6f9648755835 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:47.364736 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5c1e5dfb-be00-4fbe-bb02-6f9648755835 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:47.365225 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5c1e5dfb-be00-4fbe-bb02-6f9648755835 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:47.365660 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5c1e5dfb-be00-4fbe-bb02-6f9648755835 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:47.366361 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5c1e5dfb-be00-4fbe-bb02-6f9648755835 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:47.366813 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5c1e5dfb-be00-4fbe-bb02-6f9648755835 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:47.367276 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-5c1e5dfb-be00-4fbe-bb02-6f9648755835 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:47.515318 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-5c1e5dfb-be00-4fbe-bb02-6f9648755835 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:47.524003 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-5c1e5dfb-be00-4fbe-bb02-6f9648755835 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1758 microversion: 2.1 time: 0.170908 Sep 13 01:28:47.524575 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 516/1036] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:47 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 13 01:28:48.547582 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-05f47db2-0729-43c3-b2ce-a9c1a5684b97 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:48.548198 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-05f47db2-0729-43c3-b2ce-a9c1a5684b97 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:48.554832 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-05f47db2-0729-43c3-b2ce-a9c1a5684b97 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:48.555340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-05f47db2-0729-43c3-b2ce-a9c1a5684b97 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:48.555775 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-05f47db2-0729-43c3-b2ce-a9c1a5684b97 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:48.556465 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-05f47db2-0729-43c3-b2ce-a9c1a5684b97 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:48.556922 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-05f47db2-0729-43c3-b2ce-a9c1a5684b97 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:48.557346 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-05f47db2-0729-43c3-b2ce-a9c1a5684b97 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:48.698076 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-05f47db2-0729-43c3-b2ce-a9c1a5684b97 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:48.706148 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-05f47db2-0729-43c3-b2ce-a9c1a5684b97 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1758 microversion: 2.1 time: 0.162492 Sep 13 01:28:48.707355 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 521/1037] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:48 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:49.728906 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-0b8b048c-2233-46a7-b491-a10115f78ce2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:49.729523 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-0b8b048c-2233-46a7-b491-a10115f78ce2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:49.736004 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b8b048c-2233-46a7-b491-a10115f78ce2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:49.736488 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b8b048c-2233-46a7-b491-a10115f78ce2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:49.736928 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b8b048c-2233-46a7-b491-a10115f78ce2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:49.738117 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b8b048c-2233-46a7-b491-a10115f78ce2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:49.738582 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b8b048c-2233-46a7-b491-a10115f78ce2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:49.739045 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-0b8b048c-2233-46a7-b491-a10115f78ce2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:49.877586 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-0b8b048c-2233-46a7-b491-a10115f78ce2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:49.886477 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-0b8b048c-2233-46a7-b491-a10115f78ce2 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1758 microversion: 2.1 time: 0.161409 Sep 13 01:28:49.887142 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 517/1038] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:49 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:50.909679 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-af144e15-cb45-4136-b9bd-9bf52911ed3e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:50.910289 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-af144e15-cb45-4136-b9bd-9bf52911ed3e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:50.916841 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af144e15-cb45-4136-b9bd-9bf52911ed3e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:50.917324 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af144e15-cb45-4136-b9bd-9bf52911ed3e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:50.917756 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af144e15-cb45-4136-b9bd-9bf52911ed3e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:50.918448 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af144e15-cb45-4136-b9bd-9bf52911ed3e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:50.918914 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af144e15-cb45-4136-b9bd-9bf52911ed3e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:50.919339 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-af144e15-cb45-4136-b9bd-9bf52911ed3e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:51.016553 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1244330714", "imageRef": "63fc6ef8-ad7d-49b0-88ba-da68c14876c6", "flavorRef": "452", "networks": [{"uuid": "77dfb21b-3abb-4934-9b61-126b168eaef7"}]}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:51.061038 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-af144e15-cb45-4136-b9bd-9bf52911ed3e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:51.069897 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-af144e15-cb45-4136-b9bd-9bf52911ed3e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1758 microversion: 2.1 time: 0.164411 Sep 13 01:28:51.070456 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 522/1039] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:50 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1758 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:51.070982 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.network.neutron [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] validate_networks() for [('77dfb21b-3abb-4934-9b61-126b168eaef7', None, None, None, None, None)] {{(pid=120412) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 13 01:28:51.417641 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Flavor limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 13 01:28:51.418061 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Image limits 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 13 01:28:51.418535 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Flavor pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 13 01:28:51.418972 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Image pref 0:0:0 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 13 01:28:51.419388 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.virt.hardware [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120412) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 13 01:28:51.429074 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:51.429556 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:51.429988 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:51.430717 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:51.431201 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:51.431626 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:51.448297 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Getting quotas for project 53b74c0569e9452d817797f3f9d3a78f. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 13 01:28:51.452224 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.quota [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Getting quotas for user ed67fb86412a404d9acd882d88432b8c and project 53b74c0569e9452d817797f3f9d3a78f. Resources: {'instances', 'ram', 'cores'} {{(pid=120412) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 13 01:28:51.462627 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Going to run 1 instances... {{(pid=120412) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 13 01:28:51.464915 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='63fc6ef8-ad7d-49b0-88ba-da68c14876c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120412) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 13 01:28:51.510281 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-cb256704-df38-403e-b89c-4e0a6753c7d3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.497657 Sep 13 01:28:51.510961 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 518/1040] 10.222.0.15 () {60 vars in 1147 bytes} [Tue Sep 13 01:28:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 13 01:28:51.521903 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1cd23a6d-f590-4a14-ab9a-9be2e581238f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:51.522556 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1cd23a6d-f590-4a14-ab9a-9be2e581238f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:51.575566 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1cd23a6d-f590-4a14-ab9a-9be2e581238f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:51.582472 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1cd23a6d-f590-4a14-ab9a-9be2e581238f tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 200 len: 1219 microversion: 2.1 time: 0.064422 Sep 13 01:28:51.583083 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 523/1041] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:51 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 1219 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:52.093801 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-ba5bc042-a98a-464f-886a-8d6a8332239d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:52.094353 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-ba5bc042-a98a-464f-886a-8d6a8332239d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:52.102347 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ba5bc042-a98a-464f-886a-8d6a8332239d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:52.103665 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ba5bc042-a98a-464f-886a-8d6a8332239d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:52.104307 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ba5bc042-a98a-464f-886a-8d6a8332239d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:52.104996 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ba5bc042-a98a-464f-886a-8d6a8332239d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:52.105448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ba5bc042-a98a-464f-886a-8d6a8332239d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:52.105865 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-ba5bc042-a98a-464f-886a-8d6a8332239d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:52.289932 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-ba5bc042-a98a-464f-886a-8d6a8332239d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:52.298208 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-ba5bc042-a98a-464f-886a-8d6a8332239d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1758 microversion: 2.1 time: 0.208441 Sep 13 01:28:52.298779 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 519/1042] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:52 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1758 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:52.605086 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-bc8e2f19-49d8-4b3b-ad86-e4e6ff7e1a7a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:52.605701 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-bc8e2f19-49d8-4b3b-ad86-e4e6ff7e1a7a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:52.613102 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc8e2f19-49d8-4b3b-ad86-e4e6ff7e1a7a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:52.614840 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc8e2f19-49d8-4b3b-ad86-e4e6ff7e1a7a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:52.615928 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc8e2f19-49d8-4b3b-ad86-e4e6ff7e1a7a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:52.617840 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc8e2f19-49d8-4b3b-ad86-e4e6ff7e1a7a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:52.618873 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc8e2f19-49d8-4b3b-ad86-e4e6ff7e1a7a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:52.619644 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-bc8e2f19-49d8-4b3b-ad86-e4e6ff7e1a7a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:52.693009 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-bc8e2f19-49d8-4b3b-ad86-e4e6ff7e1a7a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:52.700348 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-bc8e2f19-49d8-4b3b-ad86-e4e6ff7e1a7a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 200 len: 1277 microversion: 2.1 time: 0.099075 Sep 13 01:28:52.700901 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 524/1043] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:52 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 1277 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:53.320742 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1808b681-7a38-4191-96f1-1a17a12298a5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:53.321361 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1808b681-7a38-4191-96f1-1a17a12298a5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:53.328263 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1808b681-7a38-4191-96f1-1a17a12298a5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:53.328751 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1808b681-7a38-4191-96f1-1a17a12298a5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:53.329182 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1808b681-7a38-4191-96f1-1a17a12298a5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:53.329890 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1808b681-7a38-4191-96f1-1a17a12298a5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:53.330341 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1808b681-7a38-4191-96f1-1a17a12298a5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:53.330754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1808b681-7a38-4191-96f1-1a17a12298a5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:53.572031 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1808b681-7a38-4191-96f1-1a17a12298a5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:53.580144 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1808b681-7a38-4191-96f1-1a17a12298a5 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1758 microversion: 2.1 time: 0.263290 Sep 13 01:28:53.580758 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 520/1044] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:53 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1758 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:53.723835 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c701c71c-9ffe-4e72-9fa7-15c13acf0fdc tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:53.724448 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c701c71c-9ffe-4e72-9fa7-15c13acf0fdc tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:53.730882 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c701c71c-9ffe-4e72-9fa7-15c13acf0fdc tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:53.731379 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c701c71c-9ffe-4e72-9fa7-15c13acf0fdc tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:53.731808 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c701c71c-9ffe-4e72-9fa7-15c13acf0fdc tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:53.732792 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c701c71c-9ffe-4e72-9fa7-15c13acf0fdc tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:53.733254 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c701c71c-9ffe-4e72-9fa7-15c13acf0fdc tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:53.733674 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c701c71c-9ffe-4e72-9fa7-15c13acf0fdc tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:53.865397 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c701c71c-9ffe-4e72-9fa7-15c13acf0fdc tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:53.873198 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c701c71c-9ffe-4e72-9fa7-15c13acf0fdc tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 200 len: 1319 microversion: 2.1 time: 0.153893 Sep 13 01:28:53.873756 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 525/1045] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:53 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:54.445649 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-5e6d725b-17f2-4625-b0c2-956f97bc6190 req-68543115-e7e8-4d0f-9d03-568539d80672 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "110d5228-f1e0-4da6-ade4-ab3da8ff0cab", "tag": "715e8911-e2d6-4c49-aab8-c07a634959e6"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:54.456196 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-5e6d725b-17f2-4625-b0c2-956f97bc6190 req-68543115-e7e8-4d0f-9d03-568539d80672 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:54.456674 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-5e6d725b-17f2-4625-b0c2-956f97bc6190 req-68543115-e7e8-4d0f-9d03-568539d80672 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:54.457100 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-5e6d725b-17f2-4625-b0c2-956f97bc6190 req-68543115-e7e8-4d0f-9d03-568539d80672 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:54.468143 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-5e6d725b-17f2-4625-b0c2-956f97bc6190 req-68543115-e7e8-4d0f-9d03-568539d80672 service nova] Creating event network-changed:715e8911-e2d6-4c49-aab8-c07a634959e6 for instance 110d5228-f1e0-4da6-ade4-ab3da8ff0cab on hv-cinder-85694 Sep 13 01:28:54.473548 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-5e6d725b-17f2-4625-b0c2-956f97bc6190 req-68543115-e7e8-4d0f-9d03-568539d80672 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031570 Sep 13 01:28:54.474283 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 521/1046] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:28:54.604151 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-1580bf0d-554e-4a40-954b-ce049b4d99f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:54.604771 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-1580bf0d-554e-4a40-954b-ce049b4d99f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:54.610583 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1580bf0d-554e-4a40-954b-ce049b4d99f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:54.611109 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1580bf0d-554e-4a40-954b-ce049b4d99f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:54.611557 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1580bf0d-554e-4a40-954b-ce049b4d99f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:54.612257 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1580bf0d-554e-4a40-954b-ce049b4d99f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:54.613352 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1580bf0d-554e-4a40-954b-ce049b4d99f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:54.613767 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-1580bf0d-554e-4a40-954b-ce049b4d99f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:54.754280 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-1580bf0d-554e-4a40-954b-ce049b4d99f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:54.762838 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-1580bf0d-554e-4a40-954b-ce049b4d99f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1758 microversion: 2.1 time: 0.162587 Sep 13 01:28:54.763436 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 526/1047] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:54 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1758 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:54.896050 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-21a5ac52-ccc5-4e47-beed-c6e4ac4fadf3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:54.896754 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-21a5ac52-ccc5-4e47-beed-c6e4ac4fadf3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:54.902799 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21a5ac52-ccc5-4e47-beed-c6e4ac4fadf3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:54.903316 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21a5ac52-ccc5-4e47-beed-c6e4ac4fadf3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:54.903756 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21a5ac52-ccc5-4e47-beed-c6e4ac4fadf3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:54.904448 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21a5ac52-ccc5-4e47-beed-c6e4ac4fadf3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:54.904906 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21a5ac52-ccc5-4e47-beed-c6e4ac4fadf3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:54.905334 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-21a5ac52-ccc5-4e47-beed-c6e4ac4fadf3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:55.034227 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-21a5ac52-ccc5-4e47-beed-c6e4ac4fadf3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:55.041816 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-21a5ac52-ccc5-4e47-beed-c6e4ac4fadf3 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 200 len: 1319 microversion: 2.1 time: 0.149999 Sep 13 01:28:55.042391 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 522/1048] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:54 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:55.786648 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-fe7de69a-d206-43a7-b7fe-b532e6b3e9db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:55.787291 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-fe7de69a-d206-43a7-b7fe-b532e6b3e9db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:55.793703 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe7de69a-d206-43a7-b7fe-b532e6b3e9db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:55.794192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe7de69a-d206-43a7-b7fe-b532e6b3e9db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:55.794630 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe7de69a-d206-43a7-b7fe-b532e6b3e9db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:55.795391 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe7de69a-d206-43a7-b7fe-b532e6b3e9db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:55.795847 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe7de69a-d206-43a7-b7fe-b532e6b3e9db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:55.796273 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-fe7de69a-d206-43a7-b7fe-b532e6b3e9db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:55.939721 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-fe7de69a-d206-43a7-b7fe-b532e6b3e9db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:55.948074 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-fe7de69a-d206-43a7-b7fe-b532e6b3e9db tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1758 microversion: 2.1 time: 0.165879 Sep 13 01:28:55.948637 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 527/1049] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:55 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1758 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:56.064497 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-83d158f4-e906-4012-9e9f-eff52ea1d3dd tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:56.065102 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-83d158f4-e906-4012-9e9f-eff52ea1d3dd tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:56.071851 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-83d158f4-e906-4012-9e9f-eff52ea1d3dd tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:56.072327 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-83d158f4-e906-4012-9e9f-eff52ea1d3dd tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:56.072752 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-83d158f4-e906-4012-9e9f-eff52ea1d3dd tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:56.073434 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-83d158f4-e906-4012-9e9f-eff52ea1d3dd tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:56.073882 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-83d158f4-e906-4012-9e9f-eff52ea1d3dd tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:56.074302 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-83d158f4-e906-4012-9e9f-eff52ea1d3dd tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:56.199029 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-83d158f4-e906-4012-9e9f-eff52ea1d3dd tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:56.207281 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-83d158f4-e906-4012-9e9f-eff52ea1d3dd tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 200 len: 1319 microversion: 2.1 time: 0.146571 Sep 13 01:28:56.207861 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 523/1050] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:56 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:56.971170 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-6243de17-49f6-486d-baf6-87d15f7831f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:56.972325 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-6243de17-49f6-486d-baf6-87d15f7831f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:56.978771 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6243de17-49f6-486d-baf6-87d15f7831f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:56.979289 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6243de17-49f6-486d-baf6-87d15f7831f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:56.979728 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6243de17-49f6-486d-baf6-87d15f7831f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:56.980428 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6243de17-49f6-486d-baf6-87d15f7831f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:56.980888 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6243de17-49f6-486d-baf6-87d15f7831f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:56.981315 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-6243de17-49f6-486d-baf6-87d15f7831f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:57.118930 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-6243de17-49f6-486d-baf6-87d15f7831f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:57.127010 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-6243de17-49f6-486d-baf6-87d15f7831f6 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1758 microversion: 2.1 time: 0.159714 Sep 13 01:28:57.127577 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 528/1051] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:56 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:57.233757 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7d1261db-f49c-49cb-9104-da92c808b089 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:57.234322 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7d1261db-f49c-49cb-9104-da92c808b089 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:57.240729 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d1261db-f49c-49cb-9104-da92c808b089 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:57.241214 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d1261db-f49c-49cb-9104-da92c808b089 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:57.241694 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d1261db-f49c-49cb-9104-da92c808b089 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:57.242348 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d1261db-f49c-49cb-9104-da92c808b089 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:57.242799 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d1261db-f49c-49cb-9104-da92c808b089 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:57.243263 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7d1261db-f49c-49cb-9104-da92c808b089 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:57.374375 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-7d1261db-f49c-49cb-9104-da92c808b089 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:57.381897 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7d1261db-f49c-49cb-9104-da92c808b089 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 200 len: 1319 microversion: 2.1 time: 0.152127 Sep 13 01:28:57.382460 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 524/1052] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:57 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:58.149502 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-684bc7b5-9d06-44f1-8757-3217f7a3cb35 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:58.150045 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-684bc7b5-9d06-44f1-8757-3217f7a3cb35 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:58.157173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-684bc7b5-9d06-44f1-8757-3217f7a3cb35 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:58.157719 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-684bc7b5-9d06-44f1-8757-3217f7a3cb35 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:58.158110 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-684bc7b5-9d06-44f1-8757-3217f7a3cb35 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:58.159114 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-684bc7b5-9d06-44f1-8757-3217f7a3cb35 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:58.159575 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-684bc7b5-9d06-44f1-8757-3217f7a3cb35 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:58.160002 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-684bc7b5-9d06-44f1-8757-3217f7a3cb35 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:58.304416 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-684bc7b5-9d06-44f1-8757-3217f7a3cb35 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:58.312538 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-684bc7b5-9d06-44f1-8757-3217f7a3cb35 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1761 microversion: 2.1 time: 0.166958 Sep 13 01:28:58.313101 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 529/1053] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:58 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1761 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:58.404865 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-c92e3d3c-056f-4f07-aa39-605e74dd9cc8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:58.405387 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-c92e3d3c-056f-4f07-aa39-605e74dd9cc8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:58.412317 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c92e3d3c-056f-4f07-aa39-605e74dd9cc8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:58.412828 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c92e3d3c-056f-4f07-aa39-605e74dd9cc8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:58.413467 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c92e3d3c-056f-4f07-aa39-605e74dd9cc8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:58.413930 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c92e3d3c-056f-4f07-aa39-605e74dd9cc8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:58.414376 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c92e3d3c-056f-4f07-aa39-605e74dd9cc8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:58.414794 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-c92e3d3c-056f-4f07-aa39-605e74dd9cc8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:58.539231 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-c92e3d3c-056f-4f07-aa39-605e74dd9cc8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:58.546716 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-c92e3d3c-056f-4f07-aa39-605e74dd9cc8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 200 len: 1319 microversion: 2.1 time: 0.145832 Sep 13 01:28:58.547321 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 525/1054] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:58 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 1319 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:28:59.570247 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-23eb3d83-d1a0-40b5-bfb3-d1499c5e6a5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:28:59.570873 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-23eb3d83-d1a0-40b5-bfb3-d1499c5e6a5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:28:59.577203 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23eb3d83-d1a0-40b5-bfb3-d1499c5e6a5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:59.577687 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23eb3d83-d1a0-40b5-bfb3-d1499c5e6a5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:59.578120 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23eb3d83-d1a0-40b5-bfb3-d1499c5e6a5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:59.578817 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23eb3d83-d1a0-40b5-bfb3-d1499c5e6a5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:59.579293 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23eb3d83-d1a0-40b5-bfb3-d1499c5e6a5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:59.579720 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-23eb3d83-d1a0-40b5-bfb3-d1499c5e6a5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:59.597648 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:28:59.624174 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [req-9d66e041-e852-407b-8d62-cea326b3b3fd req-9540e426-9c44-4a23-8dc1-1458d898f2dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110d5228-f1e0-4da6-ade4-ab3da8ff0cab", "name": "network-vif-plugged", "status": "completed", "tag": "715e8911-e2d6-4c49-aab8-c07a634959e6"}]} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:28:59.636607 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-9d66e041-e852-407b-8d62-cea326b3b3fd req-9540e426-9c44-4a23-8dc1-1458d898f2dc service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:28:59.637310 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-9d66e041-e852-407b-8d62-cea326b3b3fd req-9540e426-9c44-4a23-8dc1-1458d898f2dc service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:28:59.638024 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [req-9d66e041-e852-407b-8d62-cea326b3b3fd req-9540e426-9c44-4a23-8dc1-1458d898f2dc service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:28:59.649726 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.compute.server_external_events [req-9d66e041-e852-407b-8d62-cea326b3b3fd req-9540e426-9c44-4a23-8dc1-1458d898f2dc service nova] Creating event network-vif-plugged:715e8911-e2d6-4c49-aab8-c07a634959e6 for instance 110d5228-f1e0-4da6-ade4-ab3da8ff0cab on hv-cinder-85694 Sep 13 01:28:59.655943 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [req-9d66e041-e852-407b-8d62-cea326b3b3fd req-9540e426-9c44-4a23-8dc1-1458d898f2dc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034703 Sep 13 01:28:59.657214 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 526/1055] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:28:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:28:59.720154 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-23eb3d83-d1a0-40b5-bfb3-d1499c5e6a5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:28:59.728414 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-23eb3d83-d1a0-40b5-bfb3-d1499c5e6a5b tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 200 len: 1319 microversion: 2.1 time: 0.162662 Sep 13 01:28:59.728982 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 530/1056] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:28:59 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:29:00.754281 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-1fb2d335-9d50-4c95-995b-4f5b564117b8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:00.755010 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-1fb2d335-9d50-4c95-995b-4f5b564117b8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:00.761024 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1fb2d335-9d50-4c95-995b-4f5b564117b8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:00.761503 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1fb2d335-9d50-4c95-995b-4f5b564117b8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:00.761935 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1fb2d335-9d50-4c95-995b-4f5b564117b8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:00.762618 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1fb2d335-9d50-4c95-995b-4f5b564117b8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:00.763095 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1fb2d335-9d50-4c95-995b-4f5b564117b8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:00.763515 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-1fb2d335-9d50-4c95-995b-4f5b564117b8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:00.893740 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-1fb2d335-9d50-4c95-995b-4f5b564117b8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:29:00.901518 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-1fb2d335-9d50-4c95-995b-4f5b564117b8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 200 len: 1319 microversion: 2.1 time: 0.152459 Sep 13 01:29:00.902081 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 527/1057] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:29:00 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:29:01.924461 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c7458870-d120-4564-bfe8-fa2b28d8df0c tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:01.925078 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c7458870-d120-4564-bfe8-fa2b28d8df0c tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:01.927739 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell0:SELECT=2 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:01.933083 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c7458870-d120-4564-bfe8-fa2b28d8df0c tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:01.933567 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c7458870-d120-4564-bfe8-fa2b28d8df0c tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:01.934008 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c7458870-d120-4564-bfe8-fa2b28d8df0c tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:01.934705 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c7458870-d120-4564-bfe8-fa2b28d8df0c tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:01.935190 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c7458870-d120-4564-bfe8-fa2b28d8df0c tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:01.935616 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c7458870-d120-4564-bfe8-fa2b28d8df0c tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:02.059969 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-c7458870-d120-4564-bfe8-fa2b28d8df0c tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:29:02.067971 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c7458870-d120-4564-bfe8-fa2b28d8df0c tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 200 len: 1508 microversion: 2.1 time: 0.147400 Sep 13 01:29:02.068526 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 531/1058] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:29:01 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 1508 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:29:02.090788 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-afc2d693-f8e8-4b0c-95f1-b112ebbeecb5 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f80d71a1-35cf-4183-b1bb-5e8a5584c05c", "device": "/dev/sdb"}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:29:02.093204 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-afc2d693-f8e8-4b0c-95f1-b112ebbeecb5 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:02.095163 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:02.095823 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell0:SELECT=6 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:02.102063 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-afc2d693-f8e8-4b0c-95f1-b112ebbeecb5 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:02.102547 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-afc2d693-f8e8-4b0c-95f1-b112ebbeecb5 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:02.103019 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-afc2d693-f8e8-4b0c-95f1-b112ebbeecb5 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:02.103715 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-afc2d693-f8e8-4b0c-95f1-b112ebbeecb5 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:02.104170 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-afc2d693-f8e8-4b0c-95f1-b112ebbeecb5 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:02.104593 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-afc2d693-f8e8-4b0c-95f1-b112ebbeecb5 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:02.340426 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:02.350070 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-afc2d693-f8e8-4b0c-95f1-b112ebbeecb5 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "POST /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.263097 Sep 13 01:29:02.350692 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 528/1059] 10.222.0.15 () {60 vars in 1323 bytes} [Tue Sep 13 01:29:02 2022] POST /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab/os-volume_attachments => generated 194 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:29:19.619324 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-3799a87e-52ed-49dd-9f6b-fe14db331f92 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:19.619824 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-3799a87e-52ed-49dd-9f6b-fe14db331f92 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:19.621981 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=33 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:19.622703 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=8 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:19.629892 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3799a87e-52ed-49dd-9f6b-fe14db331f92 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:19.630440 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3799a87e-52ed-49dd-9f6b-fe14db331f92 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:19.630903 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3799a87e-52ed-49dd-9f6b-fe14db331f92 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:19.631601 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3799a87e-52ed-49dd-9f6b-fe14db331f92 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:19.632139 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3799a87e-52ed-49dd-9f6b-fe14db331f92 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:19.632618 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-3799a87e-52ed-49dd-9f6b-fe14db331f92 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:19.711757 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.objects.instance [None req-3799a87e-52ed-49dd-9f6b-fe14db331f92 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lazy-loading 'services' on Instance uuid 110d5228-f1e0-4da6-ade4-ab3da8ff0cab {{(pid=120415) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:29:19.782311 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-3799a87e-52ed-49dd-9f6b-fe14db331f92 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "DELETE /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab/os-volume_attachments/f80d71a1-35cf-4183-b1bb-5e8a5584c05c" status: 202 len: 0 microversion: 2.1 time: 0.166754 Sep 13 01:29:19.783073 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 532/1060] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 01:29:19 2022] DELETE /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab/os-volume_attachments/f80d71a1-35cf-4183-b1bb-5e8a5584c05c => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:29:20.902197 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:20.907266 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-7a1c6402-4473-4fe6-9c4f-cb488952f5a1 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:20.907844 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7a1c6402-4473-4fe6-9c4f-cb488952f5a1 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:20.915457 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7a1c6402-4473-4fe6-9c4f-cb488952f5a1 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:20.915954 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7a1c6402-4473-4fe6-9c4f-cb488952f5a1 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:20.916374 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7a1c6402-4473-4fe6-9c4f-cb488952f5a1 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:20.917072 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7a1c6402-4473-4fe6-9c4f-cb488952f5a1 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:20.917528 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7a1c6402-4473-4fe6-9c4f-cb488952f5a1 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:20.917952 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-7a1c6402-4473-4fe6-9c4f-cb488952f5a1 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:20.943869 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-7a1c6402-4473-4fe6-9c4f-cb488952f5a1 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Going to try to terminate instance {{(pid=120412) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:29:21.018210 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-7a1c6402-4473-4fe6-9c4f-cb488952f5a1 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "DELETE /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 204 len: 0 microversion: 2.1 time: 0.117630 Sep 13 01:29:21.019304 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 529/1061] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:29:20 2022] DELETE /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:29:21.029348 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-e0efcb42-ae79-4f23-a5b5-e0000d306dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:21.030056 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-e0efcb42-ae79-4f23-a5b5-e0000d306dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:21.036798 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0efcb42-ae79-4f23-a5b5-e0000d306dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:21.037288 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0efcb42-ae79-4f23-a5b5-e0000d306dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:21.037728 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0efcb42-ae79-4f23-a5b5-e0000d306dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:21.038424 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0efcb42-ae79-4f23-a5b5-e0000d306dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:21.038903 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0efcb42-ae79-4f23-a5b5-e0000d306dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:21.039335 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-e0efcb42-ae79-4f23-a5b5-e0000d306dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:21.168917 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-e0efcb42-ae79-4f23-a5b5-e0000d306dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:29:21.176754 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-e0efcb42-ae79-4f23-a5b5-e0000d306dd0 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 200 len: 1514 microversion: 2.1 time: 0.152242 Sep 13 01:29:21.177355 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 533/1062] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:29:21 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 1514 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:29:22.202253 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-dff1b05c-e742-4caf-9fd4-0e1f866d1276 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:22.202889 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-dff1b05c-e742-4caf-9fd4-0e1f866d1276 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:22.209264 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dff1b05c-e742-4caf-9fd4-0e1f866d1276 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:22.209747 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dff1b05c-e742-4caf-9fd4-0e1f866d1276 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:22.210183 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dff1b05c-e742-4caf-9fd4-0e1f866d1276 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:22.210888 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dff1b05c-e742-4caf-9fd4-0e1f866d1276 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:22.211345 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dff1b05c-e742-4caf-9fd4-0e1f866d1276 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:22.211793 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-dff1b05c-e742-4caf-9fd4-0e1f866d1276 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:22.340988 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-dff1b05c-e742-4caf-9fd4-0e1f866d1276 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:29:22.348653 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-dff1b05c-e742-4caf-9fd4-0e1f866d1276 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 200 len: 1514 microversion: 2.1 time: 0.150744 Sep 13 01:29:22.349223 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 530/1063] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:29:22 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:29:23.130663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-1ff090f2-fa31-4829-a83a-bddfaca3b439 req-8507b853-797d-4ed8-a3f7-33c3a6f435a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "110d5228-f1e0-4da6-ade4-ab3da8ff0cab", "name": "network-vif-deleted", "tag": "715e8911-e2d6-4c49-aab8-c07a634959e6"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:29:23.143194 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-1ff090f2-fa31-4829-a83a-bddfaca3b439 req-8507b853-797d-4ed8-a3f7-33c3a6f435a7 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:23.144273 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-1ff090f2-fa31-4829-a83a-bddfaca3b439 req-8507b853-797d-4ed8-a3f7-33c3a6f435a7 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:23.144701 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-1ff090f2-fa31-4829-a83a-bddfaca3b439 req-8507b853-797d-4ed8-a3f7-33c3a6f435a7 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:23.156140 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-1ff090f2-fa31-4829-a83a-bddfaca3b439 req-8507b853-797d-4ed8-a3f7-33c3a6f435a7 service nova] Creating event network-vif-deleted:715e8911-e2d6-4c49-aab8-c07a634959e6 for instance 110d5228-f1e0-4da6-ade4-ab3da8ff0cab on hv-cinder-85694 Sep 13 01:29:23.160832 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-1ff090f2-fa31-4829-a83a-bddfaca3b439 req-8507b853-797d-4ed8-a3f7-33c3a6f435a7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034609 Sep 13 01:29:23.161418 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 534/1064] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:29:23.371137 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:23.371752 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:23.378648 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:23.379162 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:23.379601 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:23.380285 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:23.380736 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:23.381157 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:23.412665 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:23.412965 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:23.413398 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:23.413842 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lazy-loading 'fault' on Instance uuid 110d5228-f1e0-4da6-ade4-ab3da8ff0cab {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:29:23.454753 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed67fb86412a404d9acd882d88432b8c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '53b74c0569e9452d817797f3f9d3a78f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:29:23.462282 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-d5ca42d3-8074-4a7b-b5d2-e7558368b90a tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 200 len: 1309 microversion: 2.1 time: 0.095072 Sep 13 01:29:23.462846 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 531/1065] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:29:23 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 1309 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:29:24.486278 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c69aaf19-a02b-4121-a6c4-697a33d4d6c8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:24.487628 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-c69aaf19-a02b-4121-a6c4-697a33d4d6c8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] [instance: 110d5228-f1e0-4da6-ade4-ab3da8ff0cab] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:24.493792 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c69aaf19-a02b-4121-a6c4-697a33d4d6c8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:24.494280 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c69aaf19-a02b-4121-a6c4-697a33d4d6c8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:24.494714 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c69aaf19-a02b-4121-a6c4-697a33d4d6c8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:24.495441 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c69aaf19-a02b-4121-a6c4-697a33d4d6c8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:24.495897 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c69aaf19-a02b-4121-a6c4-697a33d4d6c8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:24.496323 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-c69aaf19-a02b-4121-a6c4-697a33d4d6c8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:24.509305 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-c69aaf19-a02b-4121-a6c4-697a33d4d6c8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] HTTP exception thrown: Instance 110d5228-f1e0-4da6-ade4-ab3da8ff0cab could not be found. Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c69aaf19-a02b-4121-a6c4-697a33d4d6c8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Request method failure captured: Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab HTTP/1.1 Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9yQOb4QDkVSizr-oC12em-4rI26S_5cnZYYJvB9oO1894iLjSvEiAhen0LiSmdNyJ5AquGLYQYzIcxIt93HseMsOGPnTLkaqZ-LM4CRlAyaBg0IlA2L6xDyqgc_gAMQMewzZCaR_eyotEM2_sAucBMk5VJ3mXHy0hplXO8y_-aCjuU Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 53b74c0569e9452d817797f3f9d3a78f Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-VolumesSnapshotTestJSON-658966462 Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:29:24.510924 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:29:24.512627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_53b74c0569e9452d817797f3f9d3a78f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53b74c0569e9452d817797f3f9d3a78f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/53b74c0569e9452d817797f3f9d3a78f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/53b74c0569e9452d817797f3f9d3a78f"}]}] Sep 13 01:29:24.512627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-VolumesSnapshotTestJSON-658966462 Sep 13 01:29:24.512627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 53b74c0569e9452d817797f3f9d3a78f Sep 13 01:29:24.512627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-658966462 Sep 13 01:29:24.512627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-VolumesSnapshotTestJSON-658966462-project Sep 13 01:29:24.512627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:29:24.512627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:29:24.512627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: ed67fb86412a404d9acd882d88432b8c Sep 13 01:29:24.512627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-VolumesSnapshotTestJSON-658966462-project Sep 13 01:29:24.512627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:29:24.512627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 110d5228-f1e0-4da6-ade4-ab3da8ff0cab could not be found. Sep 13 01:29:24.512627 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '110d5228-f1e0-4da6-ade4-ab3da8ff0cab'} Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 110d5228-f1e0-4da6-ade4-ab3da8ff0cab could not be found. Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:29:24.513486 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 110d5228-f1e0-4da6-ade4-ab3da8ff0cab could not be found. Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 110d5228-f1e0-4da6-ade4-ab3da8ff0cab could not be found. Sep 13 01:29:24.514915 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:24.516158 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-c69aaf19-a02b-4121-a6c4-697a33d4d6c8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] Returning 404 to user: Instance 110d5228-f1e0-4da6-ade4-ab3da8ff0cab could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:29:24.516158 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-c69aaf19-a02b-4121-a6c4-697a33d4d6c8 tempest-VolumesSnapshotTestJSON-658966462 tempest-VolumesSnapshotTestJSON-658966462-project] 10.222.0.15 "GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab" status: 404 len: 111 microversion: 2.1 time: 0.030669 Sep 13 01:29:24.516158 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 535/1066] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:29:24 2022] GET /compute/v2.1/servers/110d5228-f1e0-4da6-ade4-ab3da8ff0cab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:29:36.022641 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-38e28d8e-8256-4e28-9c50-dd75fb3745df tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1894512115"}} {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:29:36.023274 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-38e28d8e-8256-4e28-9c50-dd75fb3745df tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:36.026118 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:36.026884 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG dbcounter [-] [120412] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120412) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:36.032943 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-38e28d8e-8256-4e28-9c50-dd75fb3745df tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:36.033469 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-38e28d8e-8256-4e28-9c50-dd75fb3745df tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:36.034043 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-38e28d8e-8256-4e28-9c50-dd75fb3745df tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:36.034834 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-38e28d8e-8256-4e28-9c50-dd75fb3745df tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:36.035432 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-38e28d8e-8256-4e28-9c50-dd75fb3745df tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:36.035851 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-38e28d8e-8256-4e28-9c50-dd75fb3745df tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:36.163721 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.network.security_group_api [None req-38e28d8e-8256-4e28-9c50-dd75fb3745df tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Removing security group a629ad1a-05d9-41bb-83de-d3d8353194db from port 1012c39b-1d73-4b31-9a78-4519d95f4972 Sep 13 01:29:36.480322 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-38e28d8e-8256-4e28-9c50-dd75fb3745df tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "POST /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/action" status: 202 len: 0 microversion: 2.1 time: 0.462167 Sep 13 01:29:36.489070 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 532/1067] 10.222.0.15 () {60 vars in 1278 bytes} [Tue Sep 13 01:29:36 2022] POST /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/action => generated 0 bytes in 471 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:29:36.502363 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_api:SELECT=8 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:36.503509 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG dbcounter [-] [120415] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=120415) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 01:29:36.599417 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-f7850212-6ea8-4f7a-b3f3-ed0452d98c3f req-62f4a7ba-ef16-476c-a32b-b0b98592a251 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d2d899-2749-4525-a1c3-a96617c5d619", "tag": "1012c39b-1d73-4b31-9a78-4519d95f4972"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:29:36.610636 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f7850212-6ea8-4f7a-b3f3-ed0452d98c3f req-62f4a7ba-ef16-476c-a32b-b0b98592a251 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:36.611183 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f7850212-6ea8-4f7a-b3f3-ed0452d98c3f req-62f4a7ba-ef16-476c-a32b-b0b98592a251 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:36.611621 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-f7850212-6ea8-4f7a-b3f3-ed0452d98c3f req-62f4a7ba-ef16-476c-a32b-b0b98592a251 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:36.624315 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-f7850212-6ea8-4f7a-b3f3-ed0452d98c3f req-62f4a7ba-ef16-476c-a32b-b0b98592a251 service nova] Creating event network-changed:1012c39b-1d73-4b31-9a78-4519d95f4972 for instance 09d2d899-2749-4525-a1c3-a96617c5d619 on hv-cinder-85694 Sep 13 01:29:36.630262 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-f7850212-6ea8-4f7a-b3f3-ed0452d98c3f req-62f4a7ba-ef16-476c-a32b-b0b98592a251 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.132378 Sep 13 01:29:36.631443 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 536/1068] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:29:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:29:37.590192 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-a6425659-fc59-4042-8039-e944830e1270 req-16c53c12-067d-438c-8f14-fa9147b8fa06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "09d2d899-2749-4525-a1c3-a96617c5d619", "tag": "1012c39b-1d73-4b31-9a78-4519d95f4972"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:29:37.596126 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-83e88665-bd8c-4425-89cb-47a0004095fa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:37.596518 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-83e88665-bd8c-4425-89cb-47a0004095fa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:37.604762 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-83e88665-bd8c-4425-89cb-47a0004095fa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:37.605254 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-83e88665-bd8c-4425-89cb-47a0004095fa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:37.607403 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-83e88665-bd8c-4425-89cb-47a0004095fa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:37.610126 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-a6425659-fc59-4042-8039-e944830e1270 req-16c53c12-067d-438c-8f14-fa9147b8fa06 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:37.611121 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-83e88665-bd8c-4425-89cb-47a0004095fa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:37.611797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-83e88665-bd8c-4425-89cb-47a0004095fa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:37.612454 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-83e88665-bd8c-4425-89cb-47a0004095fa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:37.615048 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-a6425659-fc59-4042-8039-e944830e1270 req-16c53c12-067d-438c-8f14-fa9147b8fa06 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:37.615813 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-a6425659-fc59-4042-8039-e944830e1270 req-16c53c12-067d-438c-8f14-fa9147b8fa06 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:37.643925 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-a6425659-fc59-4042-8039-e944830e1270 req-16c53c12-067d-438c-8f14-fa9147b8fa06 service nova] Creating event network-changed:1012c39b-1d73-4b31-9a78-4519d95f4972 for instance 09d2d899-2749-4525-a1c3-a96617c5d619 on hv-cinder-85694 Sep 13 01:29:37.656571 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-a6425659-fc59-4042-8039-e944830e1270 req-16c53c12-067d-438c-8f14-fa9147b8fa06 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066000 Sep 13 01:29:37.657336 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 537/1069] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:29:37.733434 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-83e88665-bd8c-4425-89cb-47a0004095fa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lazy-loading 'services' on Instance uuid 09d2d899-2749-4525-a1c3-a96617c5d619 {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:29:37.845116 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-83e88665-bd8c-4425-89cb-47a0004095fa tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "DELETE /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/os-volume_attachments/16b706fb-26dc-47e1-a187-af6db393b3c9" status: 202 len: 0 microversion: 2.1 time: 0.263287 Sep 13 01:29:37.846385 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 533/1070] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 01:29:37 2022] DELETE /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/os-volume_attachments/16b706fb-26dc-47e1-a187-af6db393b3c9 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 13 01:29:37.861337 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-0367427b-29c0-4cdc-9041-cc7122dbcc25 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:37.866297 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-0367427b-29c0-4cdc-9041-cc7122dbcc25 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:37.874382 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0367427b-29c0-4cdc-9041-cc7122dbcc25 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:37.875171 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0367427b-29c0-4cdc-9041-cc7122dbcc25 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:37.875768 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0367427b-29c0-4cdc-9041-cc7122dbcc25 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:37.876889 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0367427b-29c0-4cdc-9041-cc7122dbcc25 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:37.877505 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0367427b-29c0-4cdc-9041-cc7122dbcc25 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:37.879792 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-0367427b-29c0-4cdc-9041-cc7122dbcc25 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:37.916183 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-0367427b-29c0-4cdc-9041-cc7122dbcc25 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063292 Sep 13 01:29:37.917173 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 538/1071] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:29:37 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 13 01:29:38.930485 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-4bcbb59c-4b64-40de-8b05-0b2a81ee4186 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:38.932976 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-4bcbb59c-4b64-40de-8b05-0b2a81ee4186 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:38.939702 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4bcbb59c-4b64-40de-8b05-0b2a81ee4186 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:38.940184 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4bcbb59c-4b64-40de-8b05-0b2a81ee4186 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:38.940618 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4bcbb59c-4b64-40de-8b05-0b2a81ee4186 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:38.941352 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4bcbb59c-4b64-40de-8b05-0b2a81ee4186 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:38.941806 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4bcbb59c-4b64-40de-8b05-0b2a81ee4186 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:38.942227 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-4bcbb59c-4b64-40de-8b05-0b2a81ee4186 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:38.970608 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-4bcbb59c-4b64-40de-8b05-0b2a81ee4186 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045377 Sep 13 01:29:38.971351 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 534/1072] 10.222.0.15 () {58 vars in 1302 bytes} [Tue Sep 13 01:29:38 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 13 01:29:38.982663 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f17053fb-23af-455e-bca3-c0d48e723b7e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:38.983340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-f17053fb-23af-455e-bca3-c0d48e723b7e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:38.990089 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f17053fb-23af-455e-bca3-c0d48e723b7e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:38.990581 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f17053fb-23af-455e-bca3-c0d48e723b7e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:38.991059 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f17053fb-23af-455e-bca3-c0d48e723b7e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:38.991756 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f17053fb-23af-455e-bca3-c0d48e723b7e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:38.992210 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f17053fb-23af-455e-bca3-c0d48e723b7e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:38.992636 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-f17053fb-23af-455e-bca3-c0d48e723b7e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:39.066497 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-f17053fb-23af-455e-bca3-c0d48e723b7e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] HTTP exception thrown: Instance 09d2d899-2749-4525-a1c3-a96617c5d619 is not attached to volume 16b706fb-26dc-47e1-a187-af6db393b3c9 Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f17053fb-23af-455e-bca3-c0d48e723b7e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Request method failure captured: Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: DELETE /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/os-volume_attachments/16b706fb-26dc-47e1-a187-af6db393b3c9 HTTP/1.1 Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9x8mDkDDKTnAJskNj46LroC-aoNVo8QWHP9A1M00QbPb-Cgh2HEBu1iyBToGhXIRibt2wtRBcSMnYTvHn_zmy_1ychjP-CVWhmFiREuZS_FFQ4GiqgLRmh2dOWNFlx0xLswU5i517If7CB0fJDYaSq1TdijKAwcUf1GcaoyQgZ-_Js Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 7bede684fde243038bcb6b0d5c31ac8f Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-TestMinimumBasicScenario-777796342 Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:29:39.068938 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:29:39.070765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7bede684fde243038bcb6b0d5c31ac8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7bede684fde243038bcb6b0d5c31ac8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7bede684fde243038bcb6b0d5c31ac8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7bede684fde243038bcb6b0d5c31ac8f"}]}] Sep 13 01:29:39.070765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-TestMinimumBasicScenario-777796342 Sep 13 01:29:39.070765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 7bede684fde243038bcb6b0d5c31ac8f Sep 13 01:29:39.070765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-TestMinimumBasicScenario-777796342 Sep 13 01:29:39.070765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-TestMinimumBasicScenario-777796342-project Sep 13 01:29:39.070765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:29:39.070765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:29:39.070765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: d54805410115495597ef0720af2acf22 Sep 13 01:29:39.070765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-TestMinimumBasicScenario-777796342-project Sep 13 01:29:39.070765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:29:39.070765 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 09d2d899-2749-4525-a1c3-a96617c5d619 is not attached to volume 16b706fb-26dc-47e1-a187-af6db393b3c9 Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'server_id': '09d2d899-2749-4525-a1c3-a96617c5d619', 'id': '16b706fb-26dc-47e1-a187-af6db393b3c9'} Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 16b706fb-26dc-47e1-a187-af6db393b3c9. Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:29:39.071737 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d2d899-2749-4525-a1c3-a96617c5d619 is not attached to volume 16b706fb-26dc-47e1-a187-af6db393b3c9 Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d2d899-2749-4525-a1c3-a96617c5d619 is not attached to volume 16b706fb-26dc-47e1-a187-af6db393b3c9 Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:39.073642 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-f17053fb-23af-455e-bca3-c0d48e723b7e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Returning 404 to user: Instance 09d2d899-2749-4525-a1c3-a96617c5d619 is not attached to volume 16b706fb-26dc-47e1-a187-af6db393b3c9 {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:29:39.075017 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-f17053fb-23af-455e-bca3-c0d48e723b7e tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "DELETE /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/os-volume_attachments/16b706fb-26dc-47e1-a187-af6db393b3c9" status: 404 len: 154 microversion: 2.1 time: 0.091875 Sep 13 01:29:39.075176 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 539/1073] 10.222.0.15 () {58 vars in 1416 bytes} [Tue Sep 13 01:29:38 2022] DELETE /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619/os-volume_attachments/16b706fb-26dc-47e1-a187-af6db393b3c9 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:29:40.219264 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-19c4d6fa-2540-4225-9024-bd68e8a5f002 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:40.219803 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-19c4d6fa-2540-4225-9024-bd68e8a5f002 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:40.225967 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-19c4d6fa-2540-4225-9024-bd68e8a5f002 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:40.226457 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-19c4d6fa-2540-4225-9024-bd68e8a5f002 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:40.226914 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-19c4d6fa-2540-4225-9024-bd68e8a5f002 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:40.227598 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-19c4d6fa-2540-4225-9024-bd68e8a5f002 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:40.228047 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-19c4d6fa-2540-4225-9024-bd68e8a5f002 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:40.228467 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-19c4d6fa-2540-4225-9024-bd68e8a5f002 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:40.252129 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-19c4d6fa-2540-4225-9024-bd68e8a5f002 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Going to try to terminate instance {{(pid=120412) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 13 01:29:40.323526 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-19c4d6fa-2540-4225-9024-bd68e8a5f002 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "DELETE /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 204 len: 0 microversion: 2.1 time: 0.107772 Sep 13 01:29:40.324465 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 535/1074] 10.222.0.15 () {58 vars in 1239 bytes} [Tue Sep 13 01:29:40 2022] DELETE /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 13 01:29:40.333464 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-7ca0b716-9804-48d5-b3a6-daa2dc77e798 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:40.334081 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-7ca0b716-9804-48d5-b3a6-daa2dc77e798 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:40.340666 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca0b716-9804-48d5-b3a6-daa2dc77e798 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:40.341144 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca0b716-9804-48d5-b3a6-daa2dc77e798 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:40.341579 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca0b716-9804-48d5-b3a6-daa2dc77e798 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:40.342272 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca0b716-9804-48d5-b3a6-daa2dc77e798 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:40.342725 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca0b716-9804-48d5-b3a6-daa2dc77e798 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:40.343177 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-7ca0b716-9804-48d5-b3a6-daa2dc77e798 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:40.469065 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.policy [None req-7ca0b716-9804-48d5-b3a6-daa2dc77e798 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120415) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:29:40.477267 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-7ca0b716-9804-48d5-b3a6-daa2dc77e798 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1555 microversion: 2.1 time: 0.148783 Sep 13 01:29:40.477834 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 540/1075] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:29:40 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:29:41.500904 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-f2de04a8-fab0-4e47-8f8a-8ff690dbe35a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:41.501609 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-f2de04a8-fab0-4e47-8f8a-8ff690dbe35a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:41.508600 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f2de04a8-fab0-4e47-8f8a-8ff690dbe35a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:41.509089 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f2de04a8-fab0-4e47-8f8a-8ff690dbe35a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:41.509522 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f2de04a8-fab0-4e47-8f8a-8ff690dbe35a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:41.510211 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f2de04a8-fab0-4e47-8f8a-8ff690dbe35a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:41.510661 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f2de04a8-fab0-4e47-8f8a-8ff690dbe35a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:41.511111 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-f2de04a8-fab0-4e47-8f8a-8ff690dbe35a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:41.639797 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-f2de04a8-fab0-4e47-8f8a-8ff690dbe35a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:29:41.647713 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-f2de04a8-fab0-4e47-8f8a-8ff690dbe35a tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1555 microversion: 2.1 time: 0.151013 Sep 13 01:29:41.648287 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 536/1076] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:29:41 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:29:42.458091 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [req-0ea6d96b-03f0-477f-9974-b704c96ae43c req-576199d9-837e-45d7-9f6c-23e85f129fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "09d2d899-2749-4525-a1c3-a96617c5d619", "name": "network-vif-deleted", "tag": "1012c39b-1d73-4b31-9a78-4519d95f4972"}]} {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 13 01:29:42.474053 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-0ea6d96b-03f0-477f-9974-b704c96ae43c req-576199d9-837e-45d7-9f6c-23e85f129fe6 service nova] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:42.474698 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-0ea6d96b-03f0-477f-9974-b704c96ae43c req-576199d9-837e-45d7-9f6c-23e85f129fe6 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:42.475311 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [req-0ea6d96b-03f0-477f-9974-b704c96ae43c req-576199d9-837e-45d7-9f6c-23e85f129fe6 service nova] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:42.490091 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.compute.server_external_events [req-0ea6d96b-03f0-477f-9974-b704c96ae43c req-576199d9-837e-45d7-9f6c-23e85f129fe6 service nova] Creating event network-vif-deleted:1012c39b-1d73-4b31-9a78-4519d95f4972 for instance 09d2d899-2749-4525-a1c3-a96617c5d619 on hv-cinder-85694 Sep 13 01:29:42.495746 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [req-0ea6d96b-03f0-477f-9974-b704c96ae43c req-576199d9-837e-45d7-9f6c-23e85f129fe6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042408 Sep 13 01:29:42.496777 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 541/1077] 10.222.0.15 () {64 vars in 1317 bytes} [Tue Sep 13 01:29:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 13 01:29:42.670944 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:42.671481 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.compute.api [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120412) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:42.678726 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:42.679237 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:42.679674 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:42.680361 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:42.680817 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:42.681240 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:42.710204 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:42.710674 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:42.711140 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG oslo_concurrency.lockutils [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120412) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:42.711585 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.objects.instance [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lazy-loading 'fault' on Instance uuid 09d2d899-2749-4525-a1c3-a96617c5d619 {{(pid=120412) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 13 01:29:42.755232 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.policy [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd54805410115495597ef0720af2acf22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bede684fde243038bcb6b0d5c31ac8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120412) authorize /opt/stack/nova/nova/policy.py:199}} Sep 13 01:29:42.763234 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-931949c6-dbdb-4940-83e8-77784865fa19 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 200 len: 1348 microversion: 2.1 time: 0.096157 Sep 13 01:29:42.763817 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 537/1078] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:29:42 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 1348 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 13 01:29:43.786457 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-237d69e9-f398-4703-95c2-54be05c1511d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '>' {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:43.787254 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.compute.api [None req-237d69e9-f398-4703-95c2-54be05c1511d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] [instance: 09d2d899-2749-4525-a1c3-a96617c5d619] Fetching instance by UUID {{(pid=120415) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 13 01:29:43.794604 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-237d69e9-f398-4703-95c2-54be05c1511d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:43.795180 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-237d69e9-f398-4703-95c2-54be05c1511d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:43.795613 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-237d69e9-f398-4703-95c2-54be05c1511d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:43.796302 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-237d69e9-f398-4703-95c2-54be05c1511d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Acquiring lock "cf926edd-6fab-4cd6-938e-882d6f32df12" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 13 01:29:43.796742 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-237d69e9-f398-4703-95c2-54be05c1511d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 13 01:29:43.797158 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG oslo_concurrency.lockutils [None req-237d69e9-f398-4703-95c2-54be05c1511d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Lock "cf926edd-6fab-4cd6-938e-882d6f32df12" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120415) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 13 01:29:43.811059 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.wsgi [None req-237d69e9-f398-4703-95c2-54be05c1511d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] HTTP exception thrown: Instance 09d2d899-2749-4525-a1c3-a96617c5d619 could not be found. Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-237d69e9-f398-4703-95c2-54be05c1511d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Request method failure captured: Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: request: GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 HTTP/1.1 Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept: application/json Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Accept-Encoding: identity Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Connection: close Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Length: 0 Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Content-Type: application/json Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Host: 10.222.0.15 Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: Openstack-System-Scope: None Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: User-Agent: python-urllib3/1.26.12 Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Auth-Token: gAAAAABjH9x8mDkDDKTnAJskNj46LroC-aoNVo8QWHP9A1M00QbPb-Cgh2HEBu1iyBToGhXIRibt2wtRBcSMnYTvHn_zmy_1ychjP-CVWhmFiREuZS_FFQ4GiqgLRmh2dOWNFlx0xLswU5i517If7CB0fJDYaSq1TdijKAwcUf1GcaoyQgZ-_Js Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Id: None Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Domain-Name: None Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Identity-Status: Confirmed Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Is-Admin-Project: True Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Id: default Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Domain-Name: Default Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Id: 7bede684fde243038bcb6b0d5c31ac8f Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Project-Name: tempest-TestMinimumBasicScenario-777796342 Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Role: reader,member Sep 13 01:29:43.812696 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Roles: reader,member Sep 13 01:29:43.814340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7bede684fde243038bcb6b0d5c31ac8f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7bede684fde243038bcb6b0d5c31ac8f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7bede684fde243038bcb6b0d5c31ac8f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7bede684fde243038bcb6b0d5c31ac8f"}]}] Sep 13 01:29:43.814340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant: tempest-TestMinimumBasicScenario-777796342 Sep 13 01:29:43.814340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Id: 7bede684fde243038bcb6b0d5c31ac8f Sep 13 01:29:43.814340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-Tenant-Name: tempest-TestMinimumBasicScenario-777796342 Sep 13 01:29:43.814340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User: tempest-TestMinimumBasicScenario-777796342-project Sep 13 01:29:43.814340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Id: default Sep 13 01:29:43.814340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Domain-Name: Default Sep 13 01:29:43.814340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Id: d54805410115495597ef0720af2acf22 Sep 13 01:29:43.814340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: X-User-Name: tempest-TestMinimumBasicScenario-777796342-project Sep 13 01:29:43.814340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: method: > Sep 13 01:29:43.814340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: exception: Instance 09d2d899-2749-4525-a1c3-a96617c5d619 could not be found. Sep 13 01:29:43.814340 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: action_args: {'id': '09d2d899-2749-4525-a1c3-a96617c5d619'} Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: {{(pid=120415) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 09d2d899-2749-4525-a1c3-a96617c5d619 could not be found. Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 13 01:29:43.815564 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 09d2d899-2749-4525-a1c3-a96617c5d619 could not be found. Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 09d2d899-2749-4525-a1c3-a96617c5d619 could not be found. Sep 13 01:29:43.817819 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: ERROR nova.api.openstack.wsgi Sep 13 01:29:43.819758 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: DEBUG nova.api.openstack.wsgi [None req-237d69e9-f398-4703-95c2-54be05c1511d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Returning 404 to user: Instance 09d2d899-2749-4525-a1c3-a96617c5d619 could not be found. {{(pid=120415) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 13 01:29:43.819758 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: INFO nova.api.openstack.requestlog [None req-237d69e9-f398-4703-95c2-54be05c1511d tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619" status: 404 len: 111 microversion: 2.1 time: 0.031906 Sep 13 01:29:43.819758 dv-cinder-856941-3-iscsi devstack@n-api.service[120415]: [pid: 120415|app: 0|req: 542/1079] 10.222.0.15 () {58 vars in 1236 bytes} [Tue Sep 13 01:29:43 2022] GET /compute/v2.1/servers/09d2d899-2749-4525-a1c3-a96617c5d619 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 13 01:29:43.823346 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: DEBUG nova.api.openstack.wsgi [None req-298c2c0c-8b95-43ad-bab9-d22f19c60d29 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] Calling method '.version_select at 0x7fb05e2b0700>' {{(pid=120412) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 13 01:29:43.845441 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: INFO nova.api.openstack.requestlog [None req-298c2c0c-8b95-43ad-bab9-d22f19c60d29 tempest-TestMinimumBasicScenario-777796342 tempest-TestMinimumBasicScenario-777796342-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1368361343" status: 202 len: 0 microversion: 2.1 time: 0.025775 Sep 13 01:29:43.846032 dv-cinder-856941-3-iscsi devstack@n-api.service[120412]: [pid: 120412|app: 0|req: 538/1080] 10.222.0.15 () {58 vars in 1272 bytes} [Tue Sep 13 01:29:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1368361343 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)